GETTING THE TEST CASES

Because the test cases are actual virtual machines, we split them into two groups: test cases which are freely redistributable and those which are proprietary. The former are things like Fedora or CentOS images, which are free software. The latter are things like Windows or Red Hat Enterprise Linux.

The freely redistributable test cases can be downloaded from: http://git.annexia.org/?p=virt-v2v-test-cases-free.git not available yet

The proprietary test cases are available at http://git.annexia.org/?p=virt-v2v-test-cases-nonfree.git This does not contain the proprietary images themselves, which are not made available to the public for licensing reasons.

The test cases consist of disk images which are very large, from 250 MB through to tens of gigabytes each. This means that distributing test cases can be very time-consuming and expensive. We use git-annex(1) to distribute the test images.

REQUIREMENTS

It’s recommended to use an idle machine for testing. You will need a lot of disk space to run the tests, in excess of 100 GB. You should also ensure the test machine has plenty of RAM, at least 16 GB.

GETTING THE TEST HARNESS

To run the test cases you must have the virt-v2v test harness.

The OCaml module is "V2v_test_harness".

The easiest way is to compile libguestfs from source (note do not install it). The test harness will be in "libguestfs/v2v/test-harness"

It is also possible to install test harness as an OCaml module.

RUNNING THE TEST CASES

Once you have checked out the freely redistributed test cases from the repository, do:

 ./configure [--with-test-harness=/path/to/libguestfs/v2v/test-harness]
 make
 make check -k

Using the -k option is recommended so the test doesn't stop at the first failure.

PARALLEL TESTS

You can run test cases in parallel by doing:

 make check -k -j<N>

(eg. -j2 for running up to 2 tests in parallel). Be careful about running too many parallel tests, as it can slow down each test enough to cause false failures.

RUNNING TEST CASES AGAINST UPSTREAM VIRT-V2V

Using "make check" picks up whatever "virt-v2v" binary is on your $PATH.

If you have compiled libguestfs from source and want to test that version of virt-v2v, use the libguestfs "run" script (in the top-level build directory of the libguestfs sources). eg:

 ../libguestfs/run make check -k

FILES IN EACH TEST CASE

Each test case consists of:

test.img.xz

The disk image of the virtual machine before conversion. Usually this should be converted to raw format and xz-compressed.

test.ova

Alternatively, an OVA, exported from VMware, may be used.

test.xml

The libvirt XML used as input to virt-v2v. See the discussion of -i libvirtxml in virt-v2v(1).

test.ppm

An optional screenshot or screenshots.

You can supply zero or more "known good" screenshots which represent intermediate steps where the guest is booting. This is useful where a guest sits for some time doing something, and lets the test harness know that it should allow the guest to continue to boot.

You can supply zero or one "final" screenshot. This is often a screenshot of the login page which indicates that the guest booted successfully.

The screenshots are captured using virsh(1). Comparison of screenshots against the test images is done using the ImageMagick compare(1) program.

test.ml

The test itself - see below.

WRITING THE TEST

The test file (*.ml) is used to control the test harness, and minimally it would look something like this:

 open V2v_test_harness
 
 let test = "short_name"
 
 let () = run ~test ()

That would instruct the test harness to:

• Uncompress short_name.img.xz
• Run "virt-v2v -i libvirtxml short_name.xml [...]"
• Boot the resulting guest and check that it writes to its disk and then the disk becomes idle.

The above is a rather simplistic test. A more realistic test is to ensure the guest reaches a final milestone (screenshot), eg. a login page. To do that you have to supply a "~test_plan" parameter:

 open V2v_test_harness
 
 let test = "short_name"
 let test_plan = {
   default_plan with
     boot_plan = Boot_to_screenshot (test ^ ".ppm")
 }
 
 let () = run ~test ~test_plan ()

For an even better test, you can supply post-conversion and post-boot test cases which examine the disk image (using libguestfs) to verify that files have been created, modified or deleted as expected within the disk image. See V2v_test_harness.mli for more information on how to do that.

FILES GENERATED BY RUNNING THE TEST

When you run each test, the following files can be created:

test-yyyymmdd-hhmmss.scrn

Screenshot(s) of the guest’s graphical console. These are helpful when writing tests or debugging test failures.

The screenshot format is Portable Pixmap (PPM).

test.img

The uncompressed original disk image (before conversion).

test-converted-sda

test-converted.xml

The result of conversion, ie. after running virt-v2v but before test-booting the guest. See the virt-v2v(1) manual page description of -o local.

The disk image format is qcow2.

test-booted-sda

The disk image after test-booting. This is a qcow2 file which uses the test-converted-sda file as a backing disk, in order to save disk space.