open-power-host-os / tests Goto Github PK

Test Suite

License: GNU General Public License v3.0

Python 100.00%

testing test-automation test-framework test-runner linux kvm powervm powerpc opensource openpower python avocado-framework guest-vm guest-tests python3 avocado-tests

tests's Introduction

TestSuite Wrapper for Avocado Framework Tests

Overview:

This repository contains a wrapper script and configuration files to allow the user to set up the Avocado Test Framework and run a suite of tests to help verify the OpenPOWER Host OS and Guest Virtual Machine (VM) stability.

The tests are integrated into the avocado framework to increase the overall ease of use and to allow the open source community to easily add and run new tests within the suite.

See the References section below for links to the avocado framework and avocado documentation.

Operating System Support:

A PowerPC bare-metal system running OpenPOWER Host OS is required to execute any test suite in this repository (Host or Guest tests).

Guest test cases were validated against the following ppc64le guests:

RHEL 8.0+
RHEL 7.7+
Fedora 29+
Ubuntu 18.04+

Any Operating System that has python3 should be able to run this suite.

Prerequisites:

Python3 is installed on the System.

Note : If python3 bin is not pointing to python binary in the system, please create of soft link of python pointing to python3.

Example: ln -s /usr/bin/python3 /usr/bin/python

The avocado-setup.pyscript must always be run as root or as a user with root privileges or you risk permission denied errors.

The script will check your environment for tooling prerequisites and issue a warning/error if any prerequisites are not installed on the system and cannot be installed automatically.

Guest VM Install Manual Prerequisites:

Before installing the Guest VM (--install option used), you must complete the following manual tasks:

Place the ISO image for the guest OS in the isos/ folder. Download Fedora images and place them at the expected paths:

curl -o isos/Fedora-Server-DVD-ppc64le-29.iso https://archives.fedoraproject.org/pub/archive/fedora-secondary/releases/29/Server/ppc64le/iso/Fedora-Server-dvd-ppc64le-29-1.2.iso

Make sure you run python avocado-setup.py --bootstrap every time a new image is added or updated under isos/ directory.Running bootstrap will copy all images to data/avocado-vt/isos/linux/ directory.

Note: This step is not required for CentOS guest Installation, as it would pick up automatically.

Open firewall ports 8000-8020. They are needed by the avocado test framework to host the kickstart file for the guest using the default bridge network. Suggested iptables command for RHEL distribution:

iptables -t filter -I INPUT -p tcp -m state --dport 8000:8020 --state NEW -j ACCEPT

Script Usage Information:

It is highly recommended for users to execute the following command as root when running the test suite for the first time or you risk permission denied errors. See the below information for details:

$ ./avocado-setup.py --run-suite host_sanity,guest_short_sanity --install

Script help output:

$ ./avocado-setup.py -h
    usage: avocado-setup.py [-h] [--bootstrap] [--run-suite RUN_SUITE]
                            [--output-dir OUTPUTDIR] [--use-test-dir]
			    [--input-file INPUTFILE]
                            [--interval-time INTERVAL] [--verbose]
                            [--only-filter ONLY_FILTER] [--no-filter NO_FILTER]
                            [--additional-args ADD_ARGS] [--guest-os GUEST_OS]
                            [--vt {qemu,libvirt}] [--install] [--no-download]
                            [--no-deps-check] [--install-deps] [--clean]
                            [--enable-kvm]

    optional arguments:
      -h, --help            show this help message and exit
      --bootstrap           Prepare the environment for test
      --run-suite RUN_SUITE
                            Indicate which test suite(s) to run
      --output-dir OUTPUTDIR
                            Specify the custom test results directory
      --use-test-dir        Use corresponding test-name dir for storing job results
      --input-file INPUTFILE
                            Specify input file for custom mux values for host
                            tests
      --interval-time INTERVAL
                            Specify the interval time between tests
      --verbose             Enable verbose output on the console
      --only-filter ONLY_FILTER
                            Add filters to include specific avocado tests,features
                            from the guest test suite
      --no-filter NO_FILTER
                            Add filters to exclude specific avocado tests,features
                            from the guest test suite
      --additional-args ADD_ARGS
                            Pass additional arguments to the command
      --guest-os GUEST_OS   Provide Guest os: Default: JeOS.27.ppc64le
      --vt {qemu,libvirt}   Provide VT: qemu or libvirt Default: libvirt
      --install             Install the Guest VM, if needed.
      --no-download         To download the preinstalled guest image
      --no-deps-check       To force wrapper not to check for dependancy packages
      --install-deps        To force wrapper to install dependancy packages (Only
                            for Ubuntu, SLES and yum based OS)
      --clean               To remove/uninstall autotest, avocado from system
      --enable-kvm          enable bootstrap kvm tests

Argument Details:

--bootstrap:

Use this option to bootstrap the environment so that all of the required repositories (avocado, avocado-vt, avocado-misc-tests) are downloaded, installed, and configured.

Example command to bootstrap the test suite with only host tests.

./avocado-setup.py --bootstrap

Example command to bootstrap the test suite with guests tests.

./avocado-setup.py --bootstrap --enable-kvm
--run-suite RUN_SUITE:

Use this option to reference one of the files in the config/tests/host/ or config/tests/guest/{libvirt, qemu} folders. The RUN_SUITE value must be prefixed based on which folder (guest or host) the config file is located in. Multiple RUN_SUITE values must be separated by a comma.

Preconfigured possible RUN_SUITE values:

host_sanity:

This file lists the specific scripts that are run from the Avocado Test Framework avocado-misc-tests repository.

Example command to run the preconfigured Host OS test suite only:

./avocado-setup.py --run-suite host_sanity

guest_sanity:

This file runs a full series of regular and error injection tests against the specified guest VM using various virsh commands. This set of tests can take 4-5 hours to complete. The "variants:" section of the config file shows which commands are tested.

Example command to install a new Guest VM and run the preconfigured full guest test suite against it:

./avocado-setup.py --run-suite guest_sanity --install

guest_short_sanity:

This file runs a shorter series of tests against the specified guest VM using various virsh commands. This set of tests can take 1-2 hours to complete. The "variants:" section of the config file shows which commands are tested.

Example command to install a new Guest VM and run the preconfigured short guest test suite against it:

./avocado-setup.py --run-suite guest_short_sanity --install

and many more configs, can be found under host and guest
--output-dir:

Use this option to provide a custom directory for avocado test results. The avocado test results are stored in the /current_run_path/results folder by default.

Example command to run the host and guest test suite and output the test results to the /tmp folder:

./avocado-setup.py --run-suite guest_sanity,host_sanity --output-dir /tmp

NOTE: The avocado-setup.py log will always be generated at /current_run_path/avocado-wrapper.log
--use-test-dir:

Use this option to store the avocado test results in directories corresponding to the test name.

Example:

./avocado-setup.py --run-suite host_sched --use-test-dir

Results directory will contain directories with each test name /current_path/results/<test_name_1>//job.log

NOTE: This option can be used with or without the --output-dir option
--input-file:

Use this option to specify input file for custom mux values for host tests. This is a config file format, with config section indicating the test cfg file name, and the key value pairs indicating the yaml parameter to be changed and its corresponding value, respectively.

A key (yaml parameter to be changed) in an input file replaces the value (yaml parameter's value to be changed) of that yaml parameter's value in all the yaml files specified in that test cfg

Example: Consider example.cfg

It contains 1 yaml file,namely ioping.yaml Now, it has yaml parameters like mode, count, deadline, period, disk, etc. Suppose user wants to change only 3 of those values, say disk, wsize and period, user can have that alone in our input file. Refer input_example.txt for this example. Input file templates for host tests can be found at inputs
--verbose:

Use this option to display test verbose output on the console.

Example command to install a new guest VM, run the full host & guest test suites, and display verbose output on the console:

./avocado-setup.py --run-suite guest_sanity,host_sanity --install --verbose
--only-filter:

Use this option to add additional specific avocado tests or features to the guest test suite. This filter option is for advanced users of the avocado test framework who want to temporarily adjust the tests being run without having to create or change configuration files.

Example command to run the host & guest test suites and add "virtio_scsi virtio_net qcow2" filter to the guest test suite:

./avocado-setup.py --run-suite guest_cpu,host_sanity --install --only-filter "virtio_scsi virtio_net qcow2"

NOTE: Ensure you do not include a filter in the command that is a duplicate of a filter in the guest test suite being run. This could cause avocado test errors.
--no-filter:

Use this option to remove specific avocado tests or features from the guest test suite. This filter option is for advanced users of the avocado test framework who want to temporarily adjust the tests being run without having to create or change configuration files.

Example command to run the host & guest test suites and remove the "virtio_scsi" filter from the guest test suite:

python avocado-setup.py --run-suite guest_sanity,host_sanity --install --no-filter "virtio_scsi"

NOTE: Ensure you do not include a filter in the command that is a duplicate of a filter in the guest test suite being run. This could cause avocado test errors.
--additional-args:

Use this option to pass any additional avocado arguments to run tests. A preconfigured set of Host or Guest VM tests has already been provided and will run based on the value chosen for --run-suite. This additional option is for advanced users of the avocado test framework who want to run additional tests within that framework.
--guest-os:

Use this option to specify the guest os for the guest tests to run against.

By default, the value is JeOS.27.ppc64le. Supported Guests: JeOS.27.ppc64le, Fedora.31.ppc64le etc.,
--vt {qemu or libvirt}:

Use this option to choose either the libvirt or qemu folder when guest_sanity is the RUN_SUITE value. By default, the libvirt folder is used.
--install:

Use this option to install the guest VM before or during the first time that you run any guest test suite. Advanced avocado users may install their guest VM separately, but the install must follow the strict avocado configuration rules.

NOTE: Complete all Guest VM Install prerequisites listed in the Prerequisites section above BEFORE running this script with the --install option.
--no-download:

Use this option to skip the guest image download. This helps to save time when you are using an already pre-installed guest VM image.
--no-deps-check:

Force wrapper to skip check for dependancy packages. This helps to save time when re-running tests on a system where prereqs have already been checked once.
--clean:

Remove/Uninstall autotest and avocado from system after test completion.

USE IT WITH CAUTION: When this option used alone(i.e ./avocado-setup.py --clean), this will remove even the avocado config and data directory(includes guest images) and tests directoty.
--enable-kvm:

By default kvm(guest VM) tests environment is not bootstrapped, enable this flag to bootstrap KVM (guest VM) tests.

Customizing Test Suites:

The Host and Guest sanity suites were created to include a varied collection of tests to validate new Host OS installations. There are additional tests that were not included in the sanity suites that users can optionally add if they wish.

Adding Guest Sanity Tests:

You must be a proficient/advanced Avocado test suite user to correctly customize the Guest sanity suites since the syntax of these configuration files is very specific.

Adding Host Sanity Tests:

 The Host sanity tests are listed in the config/tests/host/sanity.cfg file in this repository.  These are tests used directly
  from the avocado-misc-tests respository (see link in the REFERENCE LINKS section below).  If you want to run additional
  tests from this repository, simply add a new line in the sanity.cfg file with the location of the file within the
  avocado-misc-tests repository.

  For Example:
     - A user wishes to run ras.py test in the generic folder of the avocado-misc-tests repository. The purpose of this
     test is documented within the file itself.
     - The exact location of this test in the repository is "generic/ras.py".
     - The user downloads this tests repository onto their system and edits the config/tests/host/sanity.cfg file.
     - The user adds a line "avocado-misc-tests/generic/ras.py" (without the quotes) to the end of the config/tests/host/sanity.cfg
     file in this tests repository and saves the file.
     - The user runs the host_sanity suite using the avocado-setup.py script explained in Section 4 above.
     - If the user wishes to run a test with yaml file inputs, the yaml file can be specified in the same line in the cfg file,
     separated by a space. Refer config/tests/host/example.cfg for example.
     - If the user wishes to run a test with test-specific additional arguements such as --execution-order, --mux-filer-only etc.,
     those can be specified in the same line. Note that test-specific arguements can be provided with or without the yaml,
     followed by a space within quotes. Refer config/tests/host/example.cfg for example

No Run Test:

Some tests have the potential of causing system crashes / hangs. Such test in cfg file hinders the run of tests that follow. So, if such tests are identified and need to be "not run" for a particular environment (Since they can run fine on others), we have a provision to mention such tests to not run.

Please have a look at config/wrapper/no_run_tests.conf

Pre/Post Script support:

User need to popluate their pre/post scripts as prescript and postscript directory

Create a directory named prescript inside config/ directory and populated with pre scripts
Create a directory named postscript inside config/ directory and populated with post scripts

References:

Known Issues and Limitation:

Refer to the Issues section of this repository for details on bugs, limitations, future enhancements, and investigations.

Click here to open new issue.

tests's People

Contributors

Stargazers

Watchers

tests's Issues

sprint 2: test bz: [bug] 64-bit MMIO accesses with PCI Passthrough of LSI SAS Adapter

This is test bz to track the testcases development for below new feature targeted for sprint 2:

153079 Problem with 64-bit MMIO accesses with PCI Passthrough of LSI SAS Adapter

cde:info Mirrored with LTC bug #159732 </cde:info>

Update prereq check list based on updated test suites

The host and guest test suites were recently updated, so the prereq list needs to be updates to ensure completion.

Host Sanity: avocado-misc-tests/memory/libhugetlbfs.py:libhugetlbfs.test failure

Host Sanity: avocado-misc-tests/memory/libhugetlbfs.py:libhugetlbfs.test failure

Reason for Failure:
Testcase issue

Testcases affected:
4-avocado-misc-tests/memory/libhugetlbfs.py:libhugetlbfs.test

Resolution action:
Fixed already.Awaiting to be merged in master, fix available in next branch, libhugetlbfs/libhugetlbfs@c08fb4a

Workaround:
Update this commit to the test and run manually

Guest Sanity: Boundary tests failing

Guest Sanity: Boundary tests failing

Reason for Failure:
Avocado-vt bug to login to the guest when multiple interfaces added to the guest

Testcases affected:
163-guest_sanity.boundary.network_max.spaprvlan.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.23.ppc64le.io-github-autotest-qemu.unattended_install.import.import.default_install.aio_native
165-guest_sanity.boundary.network_max.virtionet.qemu.qcow2.scsi.smp2.virtio_net.Fedora.23.ppc64le.io-github-autotest-qemu.unattended_install.import.import.default_install.aio_native

Resolution action:
Working with the Avocado-vt community to fix this issue.

Workaround:
Skip boundary tests by commenting them out in the test config file guest_sanity.cfg

Investigate potentially integrating PowerKVM Performance tests into Host OS Test Suite

cde:info Mirrored with LTC bug #159689 </cde:info>

RAS test missing from guest sanity test suite

Even though the RAS test is run in the guest short_sanity test suite, it is missing from the larger guest sanity suite (which is a superset of guest tests). This variant just needs to be added back into the guest sanity.cfg file.

Test Ubuntu Guest VM

Test run Guest VM tests against Ubuntu Guest VM. Update code and ReadMe where necessary.

cde:info Mirrored with LTC bug #157747 </cde:info>

Add Host OS test case for cpupower modification of governor settings

Add an automated test to the Host OS Test Suite to test cpupower modification of governor settings.

Need generic PowerVM versus PowerNV tags in no_run_tests.conf

Need generic PowerVM versus PowerNV tags in no_run_tests.conf which are not OS dependent.

Sprint 1: test bz: [feat] qemu fails to start with compat mode

This is test bz to track the testcases development for below new feature targeted for sprint 1:

156273 qemu fails to start with compat mode

@sathnaga will be test owner.

@sathnaga please update with the testcases meant for testing this new feature.

cde:info Mirrored with LTC bug #158306 </cde:info>

Rework no_run test category better

currently no_run has mutiple individual filters for env(NV, pHyp), OS etc, let's comeup with
better way to handle all together.

Host Sanity: Schedule-related tests failing

Reason for Failure:
Few tests are failing due to known test issues
'abort01', 'kill11', 'sched_rr_get_interval01', 'sched_rr_get_interval02', 'sched_rr_get_interval03', 'sched_setparam02', 'sched_setparam03', 'sched_getscheduler01', 'gf17'

Testcases affected:
3-avocado-misc-tests/generic/ltp.py:ltp.test

Resolution action:
Sched related tests needs to be skipped
Debug further for other few tests and add skip to the test framework permanently or fix it

Workaround:
None as of now

Update avocado-setup.py to reflect newer features

Update the avocado-setup.py script to reflect a number of newer features injected elsewhere.

cde:info Mirrored with LTC bug #157745 </cde:info>

Investigate potentially integrating automated PowerKVM System Tests into Host OS Test Suite

System test teams tend to run longer and more complex tests, some of which may be fully automated. I will investigate the automated tests further to determine if any of them could or should be integrated into the Host OS Test Suite either as part of the default sanity suite or as an optional more detailed suite.

cde:info Mirrored with LTC bug #159687 </cde:info>

Prereq Check does not locate gdb tooling when installed

Sometimes the Test suite fails the prerequisite check for "gdb-" even though the needed tooling is installed on the system.

A different or more specific check or prereq documentation is needed to resolve this.

1Q2017 - Review & Add more Guest test cases to Host OS Test Suite

Review new Guest tests during the 1st Quarter (January - March) of 2017 and add approved tests cases to the Host OS Test Suite.

Investigate and integrate 4Q2016 Distro OS tests into Host OS Test Suite

Investigate potentially integrating applicable Distro OS tests into Host OS Test Suite.

Create/Update Full OS Dependency List in README

A subset of dependencies for certain tests in the OpenPOWER Host OS Test Suite were not clear to the user.

The full list of OS dependencies (tools & settings) for the Test Suite must be documented in the README for user awareness.

A separate enhancement issue will be opened to track the integration of additional dependency checks within the Test Suite itself to automatically warn the user when one or more is missing.

1Q2017 - Review & Add more Host test cases to Host OS Test Suite

Review new Host tests during the 1st Quarter (January - March) of 2017 and add approved tests cases to the Host OS Test Suite.

Add Centos 7.2 guest support

Centos 7.2 guest support

Update ReadMe Guest OS Support List

cde:info Mirrored with LTC bug https://bugzilla.linux.ibm.com/show_bug.cgi?id=160453 </cde:info>

Recent updates submitted via the following commit enable support for running the Guest tests against additional Guest VM OS's, namely Ubuntu and SLES: ef90bb2

The OS Support section of the ReadMe needs to be updated so that users know what specific OS versions have been validated with this suite.

Change default Guest VM to CentOS

Currently the default guest VM is set to Fedora24. It needs to be changed to the latest tested CentOS version to match the testes base OS.

cde:info Mirrored with LTC bug #157750 </cde:info>

Cleanup old testproviders while bootstrapping

User might have bootstrapped with different test-provider locally, which might cause picking duplicate tests from multiple test-providers, if test-providers names are different, applicable for avocado-vt, so while using wrapper bootstrap command, lets just remove previous test-providers and start fresh.

No module named pkg_resources

while i am doing python avocado-setup.py --bootstrap
i got the error

Traceback (most recent call last):
  File "avocado-setup.py", line 23, in <module>
    import configparser
ImportError: No module named configparser

so tried to install configparser ,

 pip install configparser
Traceback (most recent call last):
  File "/usr/bin/pip", line 6, in <module>
    from pkg_resources import load_entry_point
ImportError: No module named pkg_resources

Add test case to validate systemtap

Systemtap needs to be on pair with kernel releases, e.g. kernel 4.10 requires systemtap >= 3.1. Adding a test case to validate systemtap will let us know when it stops of functioning with newer kernels.

The test case can execute

stap -v -e 'probe vfs.read {printf("read performed\n"); exit()}'

and verify its return code. This command was obtained from https://sourceware.org/systemtap/SystemTap_Beginners_Guide/using-systemtap.html#testing

Add OS dependency checks into Host OS Test Suite code

A subset of OS dependencies for more recently added tests are not being automatically checked and installed/configured (where possible).

This issue will track the addition of the applicable dependency checks into the Host OS Test Suite.

Note that a subset of dependencies (typically OS settings) will not be included in an automatic installation if we believe it could be too disruptive. Instead, those dependencies will be well documented in the README file for this Test Suite (See Issue #14 ).

Sprint 1: test bz: [feat] Virtualization support for RCU stall detector

This is test bz to track the testcases development for below new feature targeted for sprint 1:
149893 [Feature] Virtualization support for RCU stall detector

Santwana will be test owner.

Santwana please update with the testcases meant for testing this new feature.

cde:info Mirrored with LTC bug #158311 </cde:info>

Create strategy for users to run Host OS version-specific test suites

As new versions of Host OS are released, certain individual test scripts/variants within the test suite may not be compatible on all previously released versions (only support newer features, etc.). A strategy needs to be put into place to clearly indicate which pre-configured test suite can be run on which Host OS version.

Option 1: Tag the test suite repository code with a new release that matches the Host OS release where it is compatible.

Pro: It's quick and easy to do.
Con: New test script/variant releases may still be backwards compatible but would not be automatically included in previous tagged releases because of timing.

Option 2: Create Host OS version-specific test suite configuration files that include the test scripts/variants that are supported on that version.

Pro: This allows for any new test script/variant to be added to every release config file that it is compatible with, always providing the user with maximum available coverage for each relevant release.
Con: Instead of having a single release for each Host OS version, the repository will have 3-4 new test suite config files (short and full sanity suites for host and guest testing) for each Host OS version (potentially multiple Pull Requests to review and commit). More time is necessary to verify which new test scripts/variants are compatible with which releases.

Option 3: Branch the test suite into separate branches based on the Host OS release where it is compatible.

Pro: Users can choose which branch to download based on which Host OS version they plan to install (just match the version numbers). New test scripts/variants can be committed to multiple branches based on which Host OS version they are compatible with, keeping all branches updated and properly tracked with the latest coverage. The default master branch will always be the most recent and be compatible with the most recent Host OS version available.
Con: Set up and usage of multiple branches is more complex than the other options though it may be the most organized solution to the problem of potential missing coverage in previous versions.

At present I'm leaning heavily towards Option 3.

Investigate and integrate 4Q2016 Host OS I/O tests

Investigate and integrate applicable additional Host OS I/O automated tests throughout 4th quarter 2016 (4Q2016).

sprint 2: test bz: Memory hot unplug support in QEMU, libvirt

This is test tracker for dev feat : 146286 and 146285..
Memory hot unplug support in QEMU and libvirt.

@MalleshKoti would be owning this testing. He will be populating the testcases here for review.

cde:info Mirrored with LTC bug #159393 </cde:info>

Sprint 1: test bz: CPU & Memory hotplug: DRC state info transmission for migration

This is test bz to track the testcases development for below new feature targeted for sprint 1:
123907 CPU & Memory hotplug: DRC state info transmission for migration

@sathnaga will be test owner.

@sathnaga please update with the testcases meant for testing this new feature.

cde:info Mirrored with LTC bug #158309 </cde:info>

Enhance Host OS Test Suite documentation to better enable users to add their own tests to the suite

Add text and reference links in the README and/or repository Wiki to point users in the right direction to either add their tests directly to the avocado-misc-tests repository or add their tests manually to the test suite after it has already been cloned and configured (where possible).

Investigate creating new "Host_All" test suite for Host validation

The current default "sanity" test suite to validate the Host has a subset of tests that should be run to ensure the Host OS is running as expected. There are additional tests available to run that are currently not a part of the smaller sanity test suite.

A new "Host_All" suite will list all of the currently available tests that can be run against the Host OS (not the guest VM). This full suite will likely take a very long time to run, so I doubt users will run it as-is very often. A very good advantage to this suite is that it will give users a good starting point to customize their own test suite (copy the Host_All suite and then remove unwanted tests).

Tests results are not getting populated in the directory mention in the test command line.

I ran the below command line after creating a directory 'slate'
python avocado-setup.py --run-suite host_io_network_fvt --input-file input.txt --output-dir slate

Seeing issues on running this:

Results are not populated in the directory slate but under /root/avocado-fvt-wrapper/results/
Summary of the results is like below even if tests are run
15:32:20 INFO : Summary of test results can be found below:
TestSuite TestRun Summary

host_io_network_fvt_pci_hotplug_pci_hotplug Not_Run Unable to find job log file

host_io_network_fvt_driver_bind_test_driver_bind_test Not_Run Unable to find job log file

create per job config files including no_run tests if any and keep it as part of test result

Guest Sanity: Stress tests failing

Guest Sanity: Stress tests failing

Reason for Failure:
Gcc is not installed inside guest, ideally it should be available during guest install but default fedora guest iso does not have it.

Testcases affected:
174-guest_sanity.stress.disk.qemu.qcow2.spapr_vscsi.smp2.spapr-vlan.Fedora.23.ppc64le.io-github-autotest-qemu.autotest.dbench

Resolution action:
This should be fixed in the future guest versions where we can install gcc by default.

Workaround:
Yum install gcc manually and try the test.

Unable to run guest_short_sanity tests

cde:info Mirrored with LTC bug https://bugzilla.linux.ibm.com/show_bug.cgi?id=160086 </cde:info>

I've setup a CentOS 7.4 ppc64le host system and wanted to run some
guest tests, e.g.: guest_short_sanity suite against Fedora 24 ppc64le.

Avocado has thrown a lot of errors in the terminal, see below, and at
the end, it said tests were finished successfully (which is not true).

[root@baratheon tests]# iptables -t filter -I INPUT -p tcp -m state --dport 8000:8020 --state NEW -j ACCEPT


[root@baratheon tests]# iptables -nL | grep 8000
ACCEPT     tcp  --  0.0.0.0/0            0.0.0.0/0            state NEW tcp dpts:8000:8020

[root@baratheon tests]# python avocado-setup.py --bootstrap --verbose 
10:42:40 INFO    : Check for environment
10:42:40 INFO    : Creating temporary mux dir
10:42:55 INFO    : Creating Avocado Config
10:42:55 INFO    : Uninstalling avocado and autotest from environment
10:42:56 INFO    : Bootstrapping
10:42:56 INFO    : Updating the repo: avocado in /root/hostos/tests/avocado
10:42:59 INFO    : Installing repo: /root/hostos/tests/avocado
10:43:01 INFO    : Updating the repo: avocado-vt in /root/hostos/tests/avocado-vt
10:43:02 INFO    : Installing repo: /root/hostos/tests/avocado-vt
10:43:10 INFO    : Bootstrapping vt libvirt
10:43:14 INFO    : Bootstrapping vt qemu
10:43:18 INFO    : creating test repo dir /root/hostos/tests/tests
10:43:18 INFO    : Updating the repo: avocado-misc-tests in /root/hostos/tests/tests/avocado-misc-tests
10:43:20 WARNING : Avocado varianter_yaml_to_mux plugin not installed
10:43:20 INFO    : Installing optional plugin: varianter_yaml_to_mux
10:43:20 INFO    : Removing temporary mux dir

[root@baratheon tests]# python avocado-setup.py --verbose --run-suite guest_short_sanity --install --guest-os Linux.Fedora.24.ppc64le
10:44:02 INFO    : Check for environment
10:44:02 INFO    : Creating temporary mux dir
10:44:19 INFO    : Downloading the guest os image
10:44:20 INFO    : 
10:44:20 INFO    : Running Guest Tests Suite install
10:44:20 INFO    : Running: /usr/bin/avocado run --vt-type libvirt --vt-config /root/hostos/tests/data/avocado-vt/backends/libvirt/cfg/install.cfg                 --force-job-id 6d9d1205a328b06dc5b7721473b9204cb45e504a  --vt-only-filter                                             "Linux.Fedora.24.ppc64le" --show-job-log --job-results-dir /root/hostos/tests/results
found extension EntryPoint.parse('journal = avocado.plugins.journal:JournalResult')
found extension EntryPoint.parse('tap = avocado.plugins.tap:TAPResult')
found extension EntryPoint.parse('human = avocado.plugins.human:Human')
found extension EntryPoint.parse('vt-joblock = avocado_vt.plugins.vt_joblock:VTJobLock')
found extension EntryPoint.parse('teststmpdir = avocado.plugins.teststmpdir:TestsTmpDir')
found extension EntryPoint.parse('jobscripts = avocado.plugins.jobscripts:JobScripts')
found extension EntryPoint.parse('human = avocado.plugins.human:HumanJob')
Config provided, ignoring option --vt-guest-os
Config provided, ignoring option --vt-machine-type or config vt.common.machine_type
Config provided and no option --vt-qemu-img or config vt.qemu.qemu_img set. Not trying to automatically set qemu bin
Config provided, ignoring config vt.qemu.nettype
found extension EntryPoint.parse('yaml_to_mux = avocado_varianter_yaml_to_mux:YamlToMux')
Commands configured by file: /etc/avocado/sysinfo/commands
Files configured by file: /etc/avocado/sysinfo/files
Profilers configured by file: /etc/avocado/sysinfo/profilers
Command line: /usr/bin/avocado run --vt-type libvirt --vt-config /root/hostos/tests/data/avocado-vt/backends/libvirt/cfg/install.cfg --force-job-id 6d9d1205a328b06dc5b7721473b9204cb45e504a --vt-only-filter Linux.Fedora.24.ppc64le --show-job-log --job-results-dir /root/hostos/tests/results

Avocado version: 54.1

Config files read (in order):
/etc/avocado/avocado.conf
/etc/avocado/conf.d/gdb.conf
/etc/avocado/conf.d/vt.conf
/root/.config/avocado/avocado.conf

Avocado config:
Section.Key                             Value
datadir.paths.base_dir                  /root/hostos/tests
datadir.paths.test_dir                  /root/hostos/tests/tests
datadir.paths.data_dir                  /root/hostos/tests/data
datadir.paths.logs_dir                  /root/hostos/tests/results
sysinfo.collect.enabled                 True
sysinfo.collect.commands_timeout        -1
sysinfo.collect.installed_packages      False
sysinfo.collect.profiler                True
sysinfo.collect.locale                  C
sysinfo.collectibles.commands           /etc/avocado/sysinfo/commands
sysinfo.collectibles.files              /etc/avocado/sysinfo/files
sysinfo.collectibles.profilers          /etc/avocado/sysinfo/profilers
runner.output.colored                   True
runner.output.utf8                      
remoter.behavior.reject_unknown_hosts   False
remoter.behavior.disable_known_hosts    False
job.output.loglevel                     debug
restclient.connection.hostname          localhost
restclient.connection.port              9405
restclient.connection.username          
restclient.connection.password          
plugins.disable                         []
plugins.skip_broken_plugin_notification []
plugins.loaders                         ['file', '@DEFAULT']
gdb.paths.gdb                           /usr/bin/gdb
gdb.paths.gdbserver                     /usr/bin/gdbserver
vt.setup.backup_image_before_test       True
vt.setup.restore_image_after_test       True
vt.setup.keep_guest_running             False
vt.common.data_dir                      
vt.common.type_specific_only            False
vt.common.mem                           
vt.common.arch                          
vt.common.machine_type                  
vt.common.nettype                       
vt.common.netdst                        virbr0
vt.qemu.qemu_bin                        
vt.qemu.qemu_dst_bin                    
vt.qemu.accel                           kvm
vt.qemu.vhost                           off
vt.qemu.monitor                         human
vt.qemu.smp                             2
vt.qemu.image_type                      qcow2
vt.qemu.nic_model                       virtio_net
vt.qemu.disk_bus                        virtio_scsi
vt.qemu.sandbox                         on
vt.qemu.defconfig                       yes
vt.qemu.malloc_perturb                  yes
vt.libvirt.connect_uri                  qemu:///session
vt.debug.no_cleanup                     False

Avocado Data Directories:

base     /root/hostos/tests
tests    /root/hostos/tests/tests
data     /root/hostos/tests/data
logs     /root/hostos/tests/results/job-2017-10-13T10.44-6d9d120

No variants available, using defaults only

Variant :    /
Temporary dir: /var/tmp/avocado_rzpBC3

Job ID: 6d9d1205a328b06dc5b7721473b9204cb45e504a

Not logging /proc/pci (file does not exist)
Commands configured by file: /etc/avocado/sysinfo/commands
Files configured by file: /etc/avocado/sysinfo/files
Profilers configured by file: /etc/avocado/sysinfo/profilers
PARAMS (key=timeout, path=*, default=None) => None
START 1-guest_install.cdrom.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.unattended_install.cdrom.http_ks.default_install.aio_native
Avocado-VT '54.0 (RPM install)'
Test parameters:
    _name_map_file = {'install.cfg': 'guest_install.cdrom', 'drivers.cfg': 'qemu', 'guest-hw.cfg': 'bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan', 'host-os.cfg': 'Host_centos.m7.u4.Host_arch_ppc64le', 'guest-os.cfg': 'Linux.Fedora.24.ppc64le', 'machines.cfg': 'pseries', 'subtests.cfg': '(subtest=io-github-autotest-qemu).(subtest=unattended_install).cdrom.http_ks.default_install.aio_native'}
    _short_name_map_file = {'install.cfg': 'guest_install.cdrom', 'drivers.cfg': 'qemu', 'guest-hw.cfg': 'bridge.default_bios.no_virtio_rng.filesystem.no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan', 'host-os.cfg': 'Host_centos.m7.u4.Host_arch_ppc64le', 'guest-os.cfg': 'Linux.Fedora.24.ppc64le', 'machines.cfg': 'pseries', 'subtests.cfg': 'io-github-autotest-qemu.unattended_install.cdrom.http_ks.default_install.aio_native'}
    anaconda_log = yes
    auto_cpu_model = yes
    backup_dir = images/
    backup_image = yes
    backup_image_on_check_error = no
    boot_menu = off
    boot_once = d
    boot_order = cdn
    boot_path = ppc/ppc64
    catch_monitor = catch_monitor
    cdrom_cd1 = isos/linux/Fedora-Server-DVD-ppc64le-24.iso
    cdrom_check_cdrom_pattern = /dev/cdrom-\w+|/dev/cdrom\d*
    cdrom_get_cdrom_cmd = ls /dev/cdrom*
    cdrom_info_cmd = cat /proc/sys/dev/cdrom/info
    cdrom_test_cmd = dd if=%s of=/dev/null bs=1 count=1
    cdrom_unattended = images/f24-ppc64le/ks.iso
    cdroms = cd1
    check_image = yes
    cmds_installed_host = 
    connect_uri = default
    convert_ppm_files_to_png = no
    cpu_chk_cmd = grep -c processor /proc/cpuinfo
    cpu_model_flags = 
    dep = []
    display = vnc
    drive_format = scsi
    drive_index_cd1 = 1
    drive_index_image1 = 0
    drive_rerror_image1 = 
    drive_werror_image1 = 
    encode_video_files = yes
    file_transfer_client = scp
    file_transfer_port = 22
    flexible_nic_index = no
    force_create_image = yes
    guest_dmesg_ignore = False
    guest_dmesg_level = 3
    guest_port_remote_shell = 22
    guest_port_unattended_install = 12323
    hvm_or_pv = hvm
    id = guest_install.cdrom.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.unattended_install.cdrom.http_ks.default_install.aio_native
    image_aio = native
    image_backend = filesystem
    image_chain = 
    image_clone_command = cp --reflink=auto %s %s
    image_copy_on_error = no
    image_format = qcow2
    image_name = images/f24-ppc64le
    image_raw_device = no
    image_remove_command = rm -rf %s
    image_size = 10G
    image_unbootable_pattern = Hard Disk.*not a bootable disk
    image_verify_bootable = no
    images = image1
    inactivity_treshold = 1800
    inactivity_watcher = error
    indirect_image_blacklist = /dev/hda[\d]* /dev/sda[\d]* /dev/sg0 /dev/md0
    initrd = images/f24-ppc64le/initrd.img
    install_virtio = no
    keep_ppm_files = no
    keep_ppm_files_on_error = no
    keep_screendumps = no
    keep_screendumps_on_error = no
    keep_video_files = yes
    keep_video_files_on_error = yes
    kernel = images/f24-ppc64le/vmlinuz
    kernel_params = ks=cdrom nicdelay=60 console=hvc0 console=ttyS0 serial
    kill_timeout = 60
    kill_unresponsive_vms = yes
    kill_vm = yes
    kill_vm_before_test = no
    kill_vm_gracefully = yes
    kill_vm_on_error = yes
    local_ip = ENTER.YOUR.LOCAL.EXAMPLE.COM
    local_pwd = 
    login_timeout = 360
    lowest_mem = 512
    machine_type = pseries
    main_vm = virt-tests-vm1
    malloc_perturb = no
    md5sum_1m_cd1 = ba5c120a5411176da668f1b36f4e04b5
    md5sum_cd1 = 3bec30d719c512c9764c1ce5899a723b
    medium = cdrom
    mem = 32768
    mem_chk_cmd = dmidecode -t 17 | awk -F: '/Size/ {print $2}'
    mem_chk_cur_cmd = grep MemTotal /proc/meminfo
    mem_chk_re_str = [^\$]([0-9]+)
    memballoon_model = virtio
    migrate_dest_host = ENTER.YOUR.DEST.EXAMPLE.COM
    migrate_dest_pwd = PASSWORD.DEST.EXAMPLE
    migrate_load_vms = 
    migrate_main_vm = avocado-vt-vm1
    migrate_port = 49152
    migrate_proto = tcp
    migrate_shared_storage = SHARED_IMAGE.EXAMPLE
    migrate_source_host = ENTER.YOUR.SOURCE.EXAMPLE.COM
    migrate_source_pwd = PASSWORD.SOURCE.EXAMPLE
    migrate_vms = 
    monitor_type = human
    monitors = hmp1
    name = guest_install.cdrom.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.(subtest=io-github-autotest-qemu).(subtest=unattended_install).cdrom.http_ks.default_install.aio_native
    netdev_peer_re = \s{2,}(.*?): .*?\\\s(.*?):
    netdst = virbr0
    nettype = bridge
    nic_model = spapr-vlan
    nics = nic1
    os_type = linux
    os_variant = fedora24
    password = 123456
    paused_after_start_vm = no
    pci_assignable = no
    profilers = kvm_stat
    provider = io-github-autotest-qemu
    qemu_binary = qemu
    qemu_img_binary = /usr/bin/qemu-img
    qemu_io_binary = qemu-io
    reboot_command = shutdown -r now
    redirs = remote_shell unattended_install
    remote_ip = ENTER.YOUR.REMOTE.EXAMPLE.COM
    remote_pwd = 
    remote_user = root
    restore_image = no
    restore_image_on_check_error = no
    run_tcpdump = yes
    screendump_delay = 5
    screendump_quality = 30
    screendump_temp_dir = /dev/shm
    screendump_verbose = no
    serials = serial0
    shell_client = ssh
    shell_linesep = \n
    shell_port = 22
    shell_prompt = ^\[.*\][\#\$]\s*$
    shortname = guest_install.cdrom.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.unattended_install.cdrom.http_ks.default_install.aio_native
    shutdown_cleanly = yes
    shutdown_cleanly_timeout = 120
    shutdown_command = shutdown -h now
    skip_cluster_leak_warn = no
    skip_image_check_during_running = no
    skip_image_processing = no
    smp = 32
    start_vm = no
    status_test_command = echo $?
    store_vm_register = no
    strict_mode = no
    subtest = io-github-autotest-qemu.unattended_install
    syslog_server_enabled = no
    syslog_server_proto = tcp
    take_regular_screendumps = no
    test_timeout = 14400
    type = unattended_install
    unattended_delivery_method = url
    unattended_file = unattended/Fedora-24-ppc64le.ks
    unattended_file_kernel_param_name = ks
    url_auto_ip = 
    usb_bus = usb1.0
    usb_controller = xhci
    usb_devices = tablet1
    usb_max_port = 6
    usb_type = nec-usb-xhci
    usb_type_tablet1 = usb-tablet
    usb_type_usb1 = nec-usb-xhci
    usbs = usb1
    use_autostart = no
    use_check_cpu = yes
    use_debug = yes
    use_no_reboot = no
    use_os_type = yes
    use_os_variant = no
    use_virt_install_wait = no
    used_cpus = 2
    used_mem = 512
    username = root
    vcpu_cores = 4
    vcpu_sockets = 1
    vcpu_thread_pattern = thread_id.?[:|=]\s*(\d+)
    vcpu_threads = 8
    verify_guest_dmesg = yes
    verify_host_dmesg = yes
    vfd_size = 1440k
    vga = std
    virt_install_binary = /usr/bin/virt-install
    virt_install_wait_time = 300
    virt_test_type = qemu libvirt
    virtinstall_extra_args = 
    vm_arch_name = ppc64le
    vm_register_delay = 5
    vm_type = libvirt
    vms = virt-tests-vm1
    vnc_autoport = yes
Searching for test modules that match 'type = unattended_install' and 'provider = io-github-autotest-qemu' on this cartesian dict
Found subtest module /root/hostos/tests/data/avocado-vt/test-providers.d/downloads/io-github-autotest-qemu/generic/tests/unattended_install.py
Creating new, empty env file
Running 'grep cpu /proc/cpuinfo | awk '{print $3}' | head -n 1'
[stdout] POWER8E
Command 'grep cpu /proc/cpuinfo | awk '{print $3}' | head -n 1' finished with 0 after 0.00296092033386s
Running 'ppc64_cpu --smt'
[stdout] SMT is off
Command 'ppc64_cpu --smt' finished with 0 after 0.0329039096832s
KVM version: 3.10.0-693.2.2.el7.ppc64le
Could not find params qemu in /usr/share/avocado-plugins-vt/backends/libvirt/qemu, searching the host PATH for one to use
Found /usr/libexec/qemu-kvm
KVM userspace version: 2.9.0 (qemu-kvm-ev-2.9.0-16.el7_4.5.1)
Running 'true'
Command 'true' finished with 0 after 0.000446081161499s
Running 'ps -o comm 1'
[stdout] COMMAND
Command 'ps -o comm 1' finished with 0 after 0.0756039619446s
[stdout] systemd
Create image on local fs.
Context: preprocessing --> Create image by command: /usr/bin/qemu-img create -f qcow2 /root/hostos/tests/data/avocado-vt/images/f24-ppc64le.qcow2 10G
Libvirt VM 'virt-tests-vm1', driver 'qemu', uri 'qemu:///system'
VM virt-tests-vm1 does not exist
Starting unattended install setup
Releasing MAC addresses for vm virt-tests-vm1.
Checking image file /root/hostos/tests/data/avocado-vt/images/f24-ppc64le.qcow2
Image backup /root/hostos/tests/data/avocado-vt/images/f24-ppc64le.qcow2.backup already exists, skipping...
Copying /root/hostos/tests/data/avocado-vt/images/f24-ppc64le.qcow2 -> /root/hostos/tests/data/avocado-vt/images/f24-ppc64le.qcow2.backup
Running 'true'
Command 'true' finished with 0 after 0.000615119934082s
Running 'ps -o comm 1'
[stdout] COMMAND
[stdout] systemd
Command 'ps -o comm 1' finished with 0 after 0.0657088756561s

Reproduced traceback from: /usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/avocado_vt/test.py:245
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/avocado_vt/test.py", line 397, in _runTest
    run_func(self, params, env)
  File "/root/hostos/tests/data/avocado-vt/test-providers.d/downloads/io-github-autotest-qemu/generic/tests/unattended_install.py", line 14, in run
    unattended_install.run(test, params, env)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/error_context.py", line 135, in new_fn
    return fn(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/tests/unattended_install.py", line 1219, in run
    unattended_install_config.setup()
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/tests/unattended_install.py", line 1032, in setup
    self.setup_cdrom()
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/error_context.py", line 135, in new_fn
    return fn(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/tests/unattended_install.py", line 832, in setup_cdrom
    i = iso9660.Iso9660Mount(self.cdrom_cd1)
  File "/usr/lib/python2.7/site-packages/avocado_framework-54.1-py2.7.egg/avocado/utils/iso9660.py", line 313, in __init__
    super(Iso9660Mount, self).__init__(path)
  File "/usr/lib/python2.7/site-packages/avocado_framework-54.1-py2.7.egg/avocado/utils/iso9660.py", line 113, in __init__
    self._verify_path(path)
  File "/usr/lib/python2.7/site-packages/avocado_framework-54.1-py2.7.egg/avocado/utils/iso9660.py", line 127, in _verify_path
    path)
OSError: File or device path does not exist: /root/hostos/tests/data/avocado-vt/isos/linux/Fedora-Server-DVD-ppc64le-24.iso


Reproduced traceback from: /usr/lib/python2.7/site-packages/avocado_framework-54.1-py2.7.egg/avocado/core/test.py:666
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/avocado_vt/test.py", line 271, in runTest
    raise self.__status  # pylint: disable=E0702
OSError: File or device path does not exist: /root/hostos/tests/data/avocado-vt/isos/linux/Fedora-Server-DVD-ppc64le-24.iso

Local variables:
 -> self <class 'avocado_vt.test.VirtTest'>: 1-guest_install.cdrom.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.unattended_install.cdrom.http_ks.default_install.aio_native
Traceback (most recent call last):

  File "/usr/lib/python2.7/site-packages/avocado_framework-54.1-py2.7.egg/avocado/core/test.py", line 737, in _run_avocado
    raise test_exception

OSError: File or device path does not exist: /root/hostos/tests/data/avocado-vt/isos/linux/Fedora-Server-DVD-ppc64le-24.iso

ERROR 1-guest_install.cdrom.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.unattended_install.cdrom.http_ks.default_install.aio_native -> OSError: File or device path does not exist: /root/hostos/tests/data/avocado-vt/isos/linux/Fedora-Server-DVD-ppc64le-24.iso

Commands configured by file: /etc/avocado/sysinfo/commands
Files configured by file: /etc/avocado/sysinfo/files
Profilers configured by file: /etc/avocado/sysinfo/profilers
PARAMS (key=timeout, path=*, default=None) => None
START 2-guest_dep_install.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.guest_test.isa_serial_operations
Avocado-VT '54.0 (RPM install)'
Test parameters:
    _name_map_file = {'install.cfg': 'guest_dep_install', 'drivers.cfg': 'qemu', 'guest-hw.cfg': 'bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan', 'host-os.cfg': 'Host_centos.m7.u4.Host_arch_ppc64le', 'guest-os.cfg': 'Linux.Fedora.24.ppc64le', 'machines.cfg': 'pseries', 'subtests.cfg': '(subtest=io-github-autotest-qemu).(subtest=guest_test).isa_serial_operations'}
    _short_name_map_file = {'install.cfg': 'guest_dep_install', 'drivers.cfg': 'qemu', 'guest-hw.cfg': 'bridge.default_bios.no_virtio_rng.filesystem.no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan', 'host-os.cfg': 'Host_centos.m7.u4.Host_arch_ppc64le', 'guest-os.cfg': 'Linux.Fedora.24.ppc64le', 'machines.cfg': 'pseries', 'subtests.cfg': 'io-github-autotest-qemu.guest_test.isa_serial_operations'}
    auto_cpu_model = yes
    backup_dir = images/
    backup_image = no
    backup_image_on_check_error = no
    boot_menu = off
    boot_once = c
    boot_order = cdn
    boot_path = ppc/ppc64
    catch_monitor = catch_monitor
    cdrom_check_cdrom_pattern = /dev/cdrom-\w+|/dev/cdrom\d*
    cdrom_get_cdrom_cmd = ls /dev/cdrom*
    cdrom_info_cmd = cat /proc/sys/dev/cdrom/info
    cdrom_test_cmd = dd if=%s of=/dev/null bs=1 count=1
    cdroms = cd1
    check_image = yes
    cmds_installed_host = 
    connect_uri = default
    convert_ppm_files_to_png = no
    cpu_chk_cmd = grep -c processor /proc/cpuinfo
    cpu_model_flags = 
    dep = ['guest_dep_install.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.install', 'guest_dep_install.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.setup', 'guest_dep_install.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.image_copy', 'guest_dep_install.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.unattended_install.cdrom']
    display = vnc
    drive_format = scsi
    drive_index_cd1 = 1
    drive_index_image1 = 0
    drive_rerror_image1 = 
    drive_werror_image1 = 
    dst_rsc_path = /tmp/install.sh
    encode_video_files = yes
    file_transfer_client = scp
    file_transfer_port = 22
    flexible_nic_index = no
    guest_dmesg_ignore = False
    guest_dmesg_level = 3
    guest_port_remote_shell = 22
    guest_script = /tmp/install.sh
    hvm_or_pv = hvm
    id = guest_dep_install.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.guest_test.isa_serial_operations
    image_backend = filesystem
    image_chain = 
    image_clone_command = cp --reflink=auto %s %s
    image_format = qcow2
    image_name = images/f24-ppc64le
    image_raw_device = no
    image_remove_command = rm -rf %s
    image_size = 10G
    image_snapshot = yes
    image_unbootable_pattern = Hard Disk.*not a bootable disk
    image_verify_bootable = yes
    images = image1
    inactivity_treshold = 1800
    inactivity_watcher = log
    indirect_image_blacklist = /dev/hda[\d]* /dev/sda[\d]* /dev/sg0 /dev/md0
    install_virtio = no
    interpreter = sh -x 
    keep_ppm_files = no
    keep_ppm_files_on_error = no
    keep_screendumps = no
    keep_screendumps_on_error = no
    keep_video_files = yes
    keep_video_files_on_error = yes
    kill_timeout = 60
    kill_unresponsive_vms = yes
    kill_vm = no
    kill_vm_before_test = no
    kill_vm_gracefully = yes
    local_ip = ENTER.YOUR.LOCAL.EXAMPLE.COM
    local_pwd = 
    login_timeout = 360
    machine_type = pseries
    main_vm = virt-tests-vm1
    malloc_perturb = no
    mem = 32768
    mem_chk_cmd = dmidecode -t 17 | awk -F: '/Size/ {print $2}'
    mem_chk_cur_cmd = grep MemTotal /proc/meminfo
    mem_chk_re_str = [^\$]([0-9]+)
    memballoon_model = virtio
    migrate_dest_host = ENTER.YOUR.DEST.EXAMPLE.COM
    migrate_dest_pwd = PASSWORD.DEST.EXAMPLE
    migrate_load_vms = 
    migrate_main_vm = avocado-vt-vm1
    migrate_port = 49152
    migrate_proto = tcp
    migrate_shared_storage = SHARED_IMAGE.EXAMPLE
    migrate_source_host = ENTER.YOUR.SOURCE.EXAMPLE.COM
    migrate_source_pwd = PASSWORD.SOURCE.EXAMPLE
    migrate_vms = 
    monitor_type = human
    monitors = hmp1
    name = guest_dep_install.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.(subtest=io-github-autotest-qemu).(subtest=guest_test).isa_serial_operations
    netdev_peer_re = \s{2,}(.*?): .*?\\\s(.*?):
    netdst = virbr0
    nettype = bridge
    nic_model = spapr-vlan
    nics = nic1
    os_type = linux
    os_variant = fedora24
    password = 123456
    paused_after_start_vm = no
    pci_assignable = no
    post_command = \rm -f /tmp/install.sh
    pre_command = echo 'yum -y install gcc patch bzip2 patch pkgconfig gettext autoconf binutils gcc-c++ git ppc64-diag' > /tmp/install.sh
    profilers = kvm_stat
    provider = io-github-autotest-qemu
    qemu_binary = qemu
    qemu_img_binary = /usr/bin/qemu-img
    qemu_io_binary = qemu-io
    reboot = no
    reboot_command = shutdown -r now
    redirs = remote_shell
    remote_ip = ENTER.YOUR.REMOTE.EXAMPLE.COM
    remote_pwd = 
    remote_user = root
    restore_image = no
    restore_image_on_check_error = no
    run_tcpdump = yes
    screendump_delay = 5
    screendump_quality = 30
    screendump_temp_dir = /dev/shm
    screendump_verbose = no
    serial_login = yes
    serials = serial0
    shell_client = ssh
    shell_linesep = \n
    shell_port = 22
    shell_prompt = ^\[.*\][\#\$]\s*$
    shortname = guest_dep_install.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.guest_test.isa_serial_operations
    shutdown_command = shutdown -h now
    skip_cluster_leak_warn = no
    skip_image_check_during_running = no
    skip_image_processing = no
    smp = 32
    start_vm = yes
    status_test_command = echo $?
    store_vm_register = no
    strict_mode = no
    subtest = io-github-autotest-qemu.guest_test
    take_regular_screendumps = no
    test_timeout = 900
    type = guest_test
    unattended_file_kernel_param_name = ks
    url_auto_ip = 
    usb_bus = usb1.0
    usb_controller = xhci
    usb_devices = tablet1
    usb_max_port = 6
    usb_type = nec-usb-xhci
    usb_type_tablet1 = usb-tablet
    usb_type_usb1 = nec-usb-xhci
    usbs = usb1
    use_autostart = no
    use_check_cpu = yes
    use_debug = yes
    use_no_reboot = no
    use_os_type = yes
    use_os_variant = no
    use_virt_install_wait = no
    used_cpus = 2
    used_mem = 512
    username = root
    vcpu_cores = 4
    vcpu_sockets = 1
    vcpu_thread_pattern = thread_id.?[:|=]\s*(\d+)
    vcpu_threads = 8
    verify_guest_dmesg = yes
    verify_host_dmesg = yes
    vfd_size = 1440k
    vga = std
    virt_install_binary = /usr/bin/virt-install
    virt_install_wait_time = 300
    virt_test_type = qemu libvirt
    virtinstall_extra_args = 
    vm_arch_name = ppc64le
    vm_register_delay = 5
    vm_type = libvirt
    vms = virt-tests-vm1
    vnc_autoport = yes
Searching for test modules that match 'type = guest_test' and 'provider = io-github-autotest-qemu' on this cartesian dict
Found subtest module /root/hostos/tests/data/avocado-vt/test-providers.d/downloads/io-github-autotest-qemu/generic/tests/guest_test.py
Running 'grep cpu /proc/cpuinfo | awk '{print $3}' | head -n 1'
[stdout] POWER8E
Command 'grep cpu /proc/cpuinfo | awk '{print $3}' | head -n 1' finished with 0 after 0.0033860206604s
Running 'ppc64_cpu --smt'
[stdout] SMT is off
Command 'ppc64_cpu --smt' finished with 0 after 0.042228937149s
KVM version: 3.10.0-693.2.2.el7.ppc64le
Could not find params qemu in /usr/share/avocado-plugins-vt/backends/libvirt/qemu, searching the host PATH for one to use
Found /usr/libexec/qemu-kvm
KVM userspace version: 2.9.0 (qemu-kvm-ev-2.9.0-16.el7_4.5.1)
Running 'true'
Command 'true' finished with 0 after 0.000498056411743s
Running 'ps -o comm 1'
[stdout] COMMAND
Command 'ps -o comm 1' finished with 0 after 0.068717956543s
[stdout] systemd
Running 'cd /usr/share/avocado-plugins-vt; echo 'yum -y install gcc patch bzip2 patch pkgconfig gettext autoconf binutils gcc-c++ git ppc64-diag' > /tmp/install.sh'
Command 'cd /usr/share/avocado-plugins-vt; echo 'yum -y install gcc patch bzip2 patch pkgconfig gettext autoconf binutils gcc-c++ git ppc64-diag' > /tmp/install.sh' finished with 0 after 0.00221419334412s
VM virt-tests-vm1 does not exist
Checking image file /root/hostos/tests/data/avocado-vt/images/f24-ppc64le.qcow2
Running 'true'
Command 'true' finished with 0 after 0.000602960586548s
Running 'ps -o comm 1'
[stdout] COMMAND
[stdout] systemd
Command 'ps -o comm 1' finished with 0 after 0.0694620609283s
Running 'cd /usr/share/avocado-plugins-vt; \rm -f /tmp/install.sh'
Command 'cd /usr/share/avocado-plugins-vt; \rm -f /tmp/install.sh' finished with 0 after 0.00114393234253s

Reproduced traceback from: /usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/avocado_vt/test.py:245
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/avocado_vt/test.py", line 387, in _runTest
    params = env_process.preprocess(self, params, env)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/error_context.py", line 135, in new_fn
    return fn(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/env_process.py", line 874, in preprocess
    process(test, params, env, preprocess_image, preprocess_vm)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/env_process.py", line 554, in process
    _call_vm_func()
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/env_process.py", line 523, in _call_vm_func
    vm_func(test, vm_params, env, vm_name)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/env_process.py", line 138, in preprocess_vm
    raise exceptions.TestError(error_msg)
TestError: Test VM virt-tests-vm1 does not exist. Consider adding 'unattended_install.import.import.default_install.aio_native' test as the first one and 'remove_guest.without_disk' test as last one to remove the guest after testing


Reproduced traceback from: /usr/lib/python2.7/site-packages/avocado_framework-54.1-py2.7.egg/avocado/core/test.py:666
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/avocado_vt/test.py", line 271, in runTest
    raise self.__status  # pylint: disable=E0702
TestError: Test VM virt-tests-vm1 does not exist. Consider adding 'unattended_install.import.import.default_install.aio_native' test as the first one and 'remove_guest.without_disk' test as last one to remove the guest after testing

Local variables:
 -> self <class 'avocado_vt.test.VirtTest'>: 2-guest_dep_install.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.guest_test.isa_serial_operations
ERROR 2-guest_dep_install.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.guest_test.isa_serial_operations -> TestError: Test VM virt-tests-vm1 does not exist. Consider adding 'unattended_install.import.import.default_install.aio_native' test as the first one and 'remove_guest.without_disk' test as last one to remove the guest after testing

Commands configured by file: /etc/avocado/sysinfo/commands
Files configured by file: /etc/avocado/sysinfo/files
Profilers configured by file: /etc/avocado/sysinfo/profilers
PARAMS (key=timeout, path=*, default=None) => None
START 3-guest_remove.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.remove_guest.without_disk
Avocado-VT '54.0 (RPM install)'
Test parameters:
    _name_map_file = {'install.cfg': 'guest_remove', 'drivers.cfg': 'qemu', 'guest-hw.cfg': 'bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan', 'host-os.cfg': 'Host_centos.m7.u4.Host_arch_ppc64le', 'guest-os.cfg': 'Linux.Fedora.24.ppc64le', 'machines.cfg': 'pseries', 'subtests.cfg': '(subtest=io-github-autotest-libvirt).(subtest=remove_guest).without_disk'}
    _short_name_map_file = {'install.cfg': 'guest_remove', 'drivers.cfg': 'qemu', 'guest-hw.cfg': 'bridge.default_bios.no_virtio_rng.filesystem.no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan', 'host-os.cfg': 'Host_centos.m7.u4.Host_arch_ppc64le', 'guest-os.cfg': 'Linux.Fedora.24.ppc64le', 'machines.cfg': 'pseries', 'subtests.cfg': 'io-github-autotest-libvirt.remove_guest.without_disk'}
    auto_cpu_model = yes
    backup_dir = images/
    backup_image = no
    backup_image_on_check_error = no
    boot_menu = off
    boot_once = c
    boot_order = cdn
    boot_path = ppc/ppc64
    catch_monitor = catch_monitor
    cdrom_check_cdrom_pattern = /dev/cdrom-\w+|/dev/cdrom\d*
    cdrom_get_cdrom_cmd = ls /dev/cdrom*
    cdrom_info_cmd = cat /proc/sys/dev/cdrom/info
    cdrom_test_cmd = dd if=%s of=/dev/null bs=1 count=1
    cdroms = cd1
    check_image = yes
    cmds_installed_host = 
    connect_uri = default
    convert_ppm_files_to_png = no
    cpu_chk_cmd = grep -c processor /proc/cpuinfo
    cpu_model_flags = 
    dep = ['guest_remove.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.install', 'guest_remove.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.setup', 'guest_remove.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.image_copy', 'guest_remove.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.unattended_install.cdrom']
    display = vnc
    drive_format = scsi
    drive_index_cd1 = 1
    drive_index_image1 = 0
    drive_rerror_image1 = 
    drive_werror_image1 = 
    encode_video_files = yes
    file_transfer_client = scp
    file_transfer_port = 22
    flexible_nic_index = no
    force_remove_vm = yes
    guest_dmesg_ignore = False
    guest_dmesg_level = 3
    guest_port_remote_shell = 22
    hvm_or_pv = hvm
    id = guest_remove.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.remove_guest.without_disk
    image_backend = filesystem
    image_chain = 
    image_clone_command = cp --reflink=auto %s %s
    image_format = qcow2
    image_name = images/f24-ppc64le
    image_raw_device = no
    image_remove_command = rm -rf %s
    image_size = 10G
    image_unbootable_pattern = Hard Disk.*not a bootable disk
    image_verify_bootable = yes
    images = image1
    inactivity_treshold = 1800
    inactivity_watcher = log
    indirect_image_blacklist = /dev/hda[\d]* /dev/sda[\d]* /dev/sg0 /dev/md0
    install_virtio = no
    keep_ppm_files = no
    keep_ppm_files_on_error = no
    keep_screendumps = no
    keep_screendumps_on_error = no
    keep_video_files = yes
    keep_video_files_on_error = yes
    kill_timeout = 60
    kill_unresponsive_vms = yes
    kill_vm = yes
    kill_vm_before_test = no
    kill_vm_gracefully = no
    local_ip = ENTER.YOUR.LOCAL.EXAMPLE.COM
    local_pwd = 
    login_timeout = 360
    machine_type = pseries
    main_vm = virt-tests-vm1
    malloc_perturb = no
    mem = 32768
    mem_chk_cmd = dmidecode -t 17 | awk -F: '/Size/ {print $2}'
    mem_chk_cur_cmd = grep MemTotal /proc/meminfo
    mem_chk_re_str = [^\$]([0-9]+)
    memballoon_model = virtio
    migrate_dest_host = ENTER.YOUR.DEST.EXAMPLE.COM
    migrate_dest_pwd = PASSWORD.DEST.EXAMPLE
    migrate_load_vms = 
    migrate_main_vm = avocado-vt-vm1
    migrate_port = 49152
    migrate_proto = tcp
    migrate_shared_storage = SHARED_IMAGE.EXAMPLE
    migrate_source_host = ENTER.YOUR.SOURCE.EXAMPLE.COM
    migrate_source_pwd = PASSWORD.SOURCE.EXAMPLE
    migrate_vms = 
    monitor_type = human
    monitors = hmp1
    name = guest_remove.qemu.bridge.default_bios.no_virtio_rng.(image_backend=filesystem).no_9p_export.smallpages.no_pci_assignable.qcow2.scsi.smp2.spapr-vlan.Linux.Fedora.24.ppc64le.pseries.Host_centos.m7.u4.Host_arch_ppc64le.(subtest=io-github-autotest-libvirt).(subtest=remove_guest).without_disk
    netdev_peer_re = \s{2,}(.*?): .*?\\\s(.*?):
    netdst = virbr0
    nettype = bridge
    nic_model = spapr-vlan
    nics = nic1
    os_type = linux
    os_variant = fedora24
    password = 123456
    paused_after_start_vm = no
    pci_assignable = no
    profilers = kvm_stat
    provider = io-github-autotest-libvirt
    qemu_binary = qemu
    qemu_img_binary = /usr/bin/qemu-img
    qemu_io_binary = qemu-io
    reboot_command = shutdown -r now
    redirs = remote_shell
    remote_ip = ENTER.YOUR.REMOTE.EXAMPLE.COM
    remote_pwd = 
    remote_user = root
    remove_image = no
    restore_image = no
    restore_image_on_check_error = no
    run_tcpdump = yes
    screendump_delay = 5
    screendump_quality = 30
    screendump_temp_dir = /dev/shm
    screendump_verbose = no
    serials = serial0
    shell_client = ssh
    shell_linesep = \n
    shell_port = 22
    shell_prompt = ^\[.*\][\#\$]\s*$
    shortname = guest_remove.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.remove_guest.without_disk
    shutdown_command = shutdown -h now
    shutdown_method = shell
    skip_cluster_leak_warn = no
    skip_image_check_during_running = no
    skip_image_processing = no
    smp = 32
    start_vm = no
    status_test_command = echo $?
    store_vm_register = no
    strict_mode = no
    subtest = io-github-autotest-libvirt.remove_guest
    take_regular_screendumps = no
    test_timeout = 14400
    type = remove_guest
    unattended_file_kernel_param_name = ks
    url_auto_ip = 
    usb_bus = usb1.0
    usb_controller = xhci
    usb_devices = tablet1
    usb_max_port = 6
    usb_type = nec-usb-xhci
    usb_type_tablet1 = usb-tablet
    usb_type_usb1 = nec-usb-xhci
    usbs = usb1
    use_autostart = no
    use_check_cpu = yes
    use_debug = yes
    use_no_reboot = no
    use_os_type = yes
    use_os_variant = no
    use_virt_install_wait = no
    used_cpus = 2
    used_mem = 512
    username = root
    vcpu_cores = 4
    vcpu_sockets = 1
    vcpu_thread_pattern = thread_id.?[:|=]\s*(\d+)
    vcpu_threads = 8
    verify_guest_dmesg = yes
    verify_host_dmesg = yes
    vfd_size = 1440k
    vga = std
    virt_install_binary = /usr/bin/virt-install
    virt_install_wait_time = 300
    virtinstall_extra_args = 
    vm_arch_name = ppc64le
    vm_register_delay = 5
    vm_type = libvirt
    vms = virt-tests-vm1
    vnc_autoport = yes
Searching for test modules that match 'type = remove_guest' and 'provider = io-github-autotest-libvirt' on this cartesian dict
Found subtest module /root/hostos/tests/data/avocado-vt/test-providers.d/downloads/io-github-autotest-libvirt/libvirt/tests/src/remove_guest.py
Running 'grep cpu /proc/cpuinfo | awk '{print $3}' | head -n 1'
[stdout] POWER8E
Command 'grep cpu /proc/cpuinfo | awk '{print $3}' | head -n 1' finished with 0 after 0.00366997718811s
Running 'ppc64_cpu --smt'
[stdout] SMT is off
Command 'ppc64_cpu --smt' finished with 0 after 0.0527229309082s
KVM version: 3.10.0-693.2.2.el7.ppc64le
Could not find params qemu in /usr/share/avocado-plugins-vt/backends/libvirt/qemu, searching the host PATH for one to use
Found /usr/libexec/qemu-kvm
KVM userspace version: 2.9.0 (qemu-kvm-ev-2.9.0-16.el7_4.5.1)
Running 'true'
Command 'true' finished with 0 after 0.000543117523193s
Running 'ps -o comm 1'
[stdout] COMMAND
Command 'ps -o comm 1' finished with 0 after 0.069228887558s
[stdout] systemd
VM virt-tests-vm1 does not exist
Releasing MAC addresses for vm virt-tests-vm1.
Checking image file /root/hostos/tests/data/avocado-vt/images/f24-ppc64le.qcow2
Running 'true'
Command 'true' finished with 0 after 0.000604152679443s
Running 'ps -o comm 1'
[stdout] COMMAND
Command 'ps -o comm 1' finished with 0 after 0.0685820579529s
[stdout] systemd

Reproduced traceback from: /usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/avocado_vt/test.py:245
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/avocado_vt/test.py", line 387, in _runTest
    params = env_process.preprocess(self, params, env)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/error_context.py", line 135, in new_fn
    return fn(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/env_process.py", line 874, in preprocess
    process(test, params, env, preprocess_image, preprocess_vm)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/env_process.py", line 554, in process
    _call_vm_func()
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/env_process.py", line 523, in _call_vm_func
    vm_func(test, vm_params, env, vm_name)
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/virttest/env_process.py", line 138, in preprocess_vm
    raise exceptions.TestError(error_msg)
TestError: Test VM virt-tests-vm1 does not exist. Consider adding 'unattended_install.import.import.default_install.aio_native' test as the first one and 'remove_guest.without_disk' test as last one to remove the guest after testing


Reproduced traceback from: /usr/lib/python2.7/site-packages/avocado_framework-54.1-py2.7.egg/avocado/core/test.py:666
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/avocado_plugins_vt-54.0-py2.7.egg/avocado_vt/test.py", line 271, in runTest
    raise self.__status  # pylint: disable=E0702
TestError: Test VM virt-tests-vm1 does not exist. Consider adding 'unattended_install.import.import.default_install.aio_native' test as the first one and 'remove_guest.without_disk' test as last one to remove the guest after testing

Local variables:
 -> self <class 'avocado_vt.test.VirtTest'>: 3-guest_remove.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.remove_guest.without_disk
ERROR 3-guest_remove.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.remove_guest.without_disk -> TestError: Test VM virt-tests-vm1 does not exist. Consider adding 'unattended_install.import.import.default_install.aio_native' test as the first one and 'remove_guest.without_disk' test as last one to remove the guest after testing

Not logging /proc/pci (file does not exist)
Releasing MAC addresses for vm virt-tests-vm1.
Test results available in /root/hostos/tests/results/job-2017-10-13T10.44-6d9d120
10:44:28 INFO    : 
10:44:28 INFO    : 
10:44:28 INFO    : Running Guest Tests Suite short_sanity
10:44:28 INFO    : Running: /usr/bin/avocado run --vt-type libvirt --vt-config /root/hostos/tests/data/avocado-vt/backends/libvirt/cfg/short_sanity.cfg                 --force-job-id 21b667f3cf92dea20de2928ddb510139cf41a334  --vt-only-filter Linux.Fedora.24.ppc64le 
JOB ID     : 21b667f3cf92dea20de2928ddb510139cf41a334
JOB LOG    : /root/hostos/tests/results/job-2017-10-13T10.44-21b667f/job.log
 (01/85) guest_short_sanity.import.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-qemu.unattended_install.import.import.default_install.aio_native: ERROR (3.61 s)
 (02/85) guest_short_sanity.cpu.cpu_compare.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.cpu_compare.host_cpu.no_cpu_match.default_feature: ERROR (1.04 s)
 (03/85) guest_short_sanity.cpu.numatune.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.numatune.positive_testing.get_numa_parameter.running_guest.options.none: ERROR (1.06 s)
 (04/85) guest_short_sanity.cpu.vcpuinfo.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.vcpuinfo.normal_test.id_option: ERROR (1.15 s)
 (05/85) guest_short_sanity.cpu.vcpupin.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.vcpupin.online.positive_test.dom_name: ERROR (1.07 s)
 (06/85) guest_short_sanity.cpu.maxvcpus.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.maxvcpus.connect_to_local.no_option: ERROR (1.06 s)
 (07/85) guest_short_sanity.cpu.nodecpumap.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.nodecpumap.no_option: ERROR (1.08 s)
 (08/85) guest_short_sanity.cpu.schedinfo.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.schedinfo_qemu_posix.normal_test.show_schedinfo.valid_domname: ERROR (1.05 s)
 (09/85) guest_short_sanity.memory.freecell.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.freecell.libvirton.expected_options.no_option: ERROR (1.05 s)
 (10/85) guest_short_sanity.memory.memtune.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.memtune: ERROR (1.06 s)
 (11/85) guest_short_sanity.memory.nodememstats.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.nodememstats.no_option: ERROR (1.08 s)
 (12/85) guest_short_sanity.memory.nodememstats.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.nodememstats.with_libvirtd_stop: ERROR (1.08 s)
 (13/85) guest_short_sanity.memory.node_memtune.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.node_memtune.positive_testing.get_node_memory_parameter: ERROR (1.06 s)
 (14/85) guest_short_sanity.memory.setmaxmem.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.setmaxmem.normal_test.config.running.half_mem.domname.dom_arg_size_arg: ERROR (1.06 s)
 (15/85) guest_short_sanity.memory.setmem.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.setmem.invalid_options.shut_off.empty_size.missing_name: ERROR (1.14 s)
 (16/85) guest_short_sanity.network.domiflist.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domiflist.with_valid_option.domid: ERROR (1.00 s)
 (17/85) guest_short_sanity.network.domifstat.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domifstat.normal_test.id_option: ERROR (1.06 s)
 (18/85) guest_short_sanity.network.domifstat.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domifstat.error_test.no_option: ERROR (1.07 s)
 (19/85) guest_short_sanity.network.domiftune.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domiftune.positive_testing.get_domif_parameter.running_guest.options.none: ERROR (1.06 s)
 (20/85) guest_short_sanity.network.net-autostart.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.net_autostart.normal_test.set_autostart.netname: ERROR (0.90 s)
 (21/85) guest_short_sanity.network.net-create.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.net_create.normal_test.file_as_argument.default_config: ERROR (1.03 s)
 (22/85) guest_short_sanity.network.net-destroy.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.net_destroy.normal_test.non_acl.default_option: ERROR (0.86 s)
 (23/85) guest_short_sanity.network.net-dumpxml.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.net_dumpxml.normal_test.non_acl.name_option:ERROR (0.88 s)
 (24/85) guest_short_sanity.network.net-info.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.net_info.normal_test.name_option: ERROR (0.89 s)
 (25/85) guest_short_sanity.network.net-name.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.net_name.uuid_option: ERROR (0.86 s)
 (26/85) guest_short_sanity.network.net-start.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.net_start.normal_test.non_acl.valid_netname: ERROR (0.90 s)
 (27/85) guest_short_sanity.network.net-uuid.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.net_uuid.name_option: ERROR (0.86 s)
 (28/85) guest_short_sanity.network.nwfilter-define.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.nwfilter_define.update_exist_filter.non_acl.same_uuid: ERROR (1.07 s)
 (29/85) guest_short_sanity.network.nwfilter-dumpxml.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.nwfilter_dumpxml.normal_test.non_acl: ERROR (1.05 s)
 (30/85) guest_short_sanity.network.nwfilter-edit.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.nwfilter_edit.positive_test.use_name: ERROR (1.05 s)
 (31/85) guest_short_sanity.network.nwfilter-list.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.nwfilter_list.normal_test.non_acl: ERROR (1.05 s)
 (32/85) guest_short_sanity.network.nwfilter-undefine.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.nwfilter_undefine.normal_test.non_acl:ERROR (1.05 s)
 (33/85) guest_short_sanity.storage.domblkinfo.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domblkinfo.normal_test.id_option: ERROR (1.15 s)
 (34/85) guest_short_sanity.storage.domblklist.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domblklist.normal_test.id_option: ERROR (1.15 s)
 (35/85) guest_short_sanity.storage.domblkstat.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domblkstat.normal_test.id_option: ERROR (1.05 s)
 (36/85) guest_short_sanity.storage.find-storage-pool-sources-as.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.find_storage_pool_sources_as.positive_test.local_source.nfs_type: ERROR (1.07 s)
 (37/85) guest_short_sanity.storage.pool.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.pool.positive_test.pool_type_dir: ERROR (1.07 s)
 (38/85) guest_short_sanity.storage.pool-create.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.pool_create.positive_test.from_pre_def_pool.dir_pool: ERROR (1.06 s)
 (39/85) guest_short_sanity.storage.pool-create-as.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.pool_create_as: ERROR (1.05 s)
 (40/85) guest_short_sanity.storage.pool-edit.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.pool_edit.positive_test.name_option.dir_pool.edit_pool_target: ERROR (1.07 s)
 (41/85) guest_short_sanity.storage.vol-create-from.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.vol_create_from.positive_test.dest_vol_format.v_qcow2.src_vol_format.v_qcow2.dest_pool_type.dir.src_pool_type.dir: ERROR (1.04 s)
 (42/85) guest_short_sanity.storage.volume.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.volume.dir_pool.vol_encrypt_none.vol_format_qcow.vol_allocation.normal_size: ERROR (1.08 s)
 (43/85) guest_short_sanity.hotplug.disk.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.attach_detach_disk.attach_disk.error_test.no_vm_name: ERROR (1.05 s)
 (44/85) guest_short_sanity.hotplug.change-media.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.change_media.cdrom_test.scsi_.positive_test.eject.none.running_guest: ERROR (1.17 s)
 (45/85) guest_short_sanity.hotplug.memory.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.libvirt_mem.positive_test.hot_plug: ERROR (1.07 s)
 (46/85) guest_short_sanity.lifecycle.autostart.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.autostart.positive_test.set_autostart: ERROR (1.05 s)
 (47/85) guest_short_sanity.lifecycle.capabilities.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.capabilities.no_option: ERROR (1.04 s)
 (48/85) guest_short_sanity.lifecycle.connect.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.connect.local_connect.normal_test.default: ERROR (1.01 s)
 (49/85) guest_short_sanity.lifecycle.console.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.console.normal_test.non_acl.valid_domname: ERROR (1.05 s)
 (50/85) guest_short_sanity.lifecycle.create.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.create.none: ERROR (1.04 s)
 (51/85) guest_short_sanity.lifecycle.create.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.create.negtive_readonly: ERROR (1.05 s)
 (52/85) guest_short_sanity.lifecycle.define.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.define.number: ERROR (1.03 s)
 (53/85) guest_short_sanity.lifecycle.desc.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.desc.positive_test.no_option: ERROR (1.07 s)
 (54/85) guest_short_sanity.lifecycle.destroy.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.destroy.normal_test.non_acl.id_option: ERROR (1.07 s)
 (55/85) guest_short_sanity.lifecycle.domid.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domid.normal_test.name_option: ERROR (1.05 s)
 (56/85) guest_short_sanity.lifecycle.dominfo.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.dominfo.normal_test.id_option: ERROR (1.03 s)
 (57/85) guest_short_sanity.lifecycle.domjobabort.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domjobabort.normal_test.id_option: ERROR (1.17 s)
 (58/85) guest_short_sanity.lifecycle.domjobinfo.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domjobinfo.normal_test.id_option: ERROR (1.06 s)
 (59/85) guest_short_sanity.lifecycle.domname.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domname.vm_state.vm_running.with_valid_option.domid: ERROR (0.96 s)
 (60/85) guest_short_sanity.lifecycle.domstate.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domstate.normal_test.id_option: ERROR (1.15 s)
 (61/85) guest_short_sanity.lifecycle.domuuid.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domuuid.normal_test.vm_running.valid_domid: ERROR (1.05 s)
 (62/85) guest_short_sanity.lifecycle.domxml-native.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.domxml_to_native.no_option: ERROR (1.07 s)
 (63/85) guest_short_sanity.lifecycle.dumpxml.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.dumpxml.normal_test.non_acl.vm_shutoff.with_default.domuuid: ERROR (1.05 s)
 (64/85) guest_short_sanity.lifecycle.edit.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.edit.negative_test.no_option.edit_vcpu: ERROR (1.07 s)
 (65/85) guest_short_sanity.lifecycle.help.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.help.normal_test.no_option: ERROR (0.86 s)
 (66/85) guest_short_sanity.lifecycle.hostname.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.hostname.no_option: ERROR (1.06 s)
 (67/85) guest_short_sanity.lifecycle.list.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.list.normal_test.with_valid_options.list_table.inactive: ERROR (1.15 s)
 (68/85) guest_short_sanity.lifecycle.restore.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.restore.expected_option.non_acl.no_option: ERROR (1.15 s)
 (69/85) guest_short_sanity.lifecycle.resume.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.resume.normal_test.vm_paused.valid_domname: ERROR (1.06 s)
 (70/85) guest_short_sanity.lifecycle.secret.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.secret_set_get.positive_testing.public_secret: ERROR (1.07 s)
 (71/85) guest_short_sanity.lifecycle.suspend.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.suspend.normal_test.non_acl.id_option: ERROR (1.16 s)
 (72/85) guest_short_sanity.lifecycle.ttyconsole.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.ttyconsole.normal_test.vm_running.domname: ERROR (1.03 s)
 (73/85) guest_short_sanity.lifecycle.undefine.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.undefine.normal_test.vm_shut_off.no_option: ERROR (1.14 s)
 (74/85) guest_short_sanity.lifecycle.uri.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.uri.no_option.connect_to_local: ERROR (1.05 s)
 (75/85) guest_short_sanity.lifecycle.uri.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.uri.unexpect_option: ERROR (1.05 s)
 (76/85) guest_short_sanity.lifecycle.version.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.version.no_option: ERROR (1.05 s)
 (77/85) guest_short_sanity.lifecycle.version.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.version.unexpect_option: ERROR (1.05 s)
 (78/85) guest_short_sanity.lifecycle.vncdisplay.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.vncdisplay.normal_test.id_option: ERROR (1.05 s)
 (79/85) guest_short_sanity.ras.dump.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.dump.positive_test.non_acl.live_dump: ERROR (1.15 s)
 (80/85) guest_short_sanity.backuprestore.save.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.save.normal_test.id_option.no_option.no_progress: ERROR (1.15 s)
 (81/85) guest_short_sanity.backuprestore.snapshot-disk.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.snapshot_disk.no_delete.positive_test.pool_vol.dir_pool.attach_img_raw.snapshot_from_xml.disk_external.sys_checkpoint.default.memory_external: ERROR (1.09 s)
 (82/85) guest_short_sanity.backuprestore.snapshot-dumpxml.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.snapshot_dumpxml.negative_tests.readonly: ERROR (1.06 s)
 (83/85) guest_short_sanity.backuprestore.snapshot-edit.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.snapshot_edit.positive_tests.edit_option_rename.edit_option_current_and_snapname.mem_snapshot.disk_snapshot: ERROR (1.06 s)
 (84/85) guest_short_sanity.backuprestore.snapshot-par-cur.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.virsh.snapshot_par_cur.current_option.readonly: ERROR (1.07 s)
 (85/85) guest_short_sanity.delete_guest.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.24.ppc64le.io-github-autotest-libvirt.remove_guest.without_disk: ERROR (1.11 s)
RESULTS    : PASS 0 | ERROR 85 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB TIME   : 124.51 s
JOB HTML   : /root/hostos/tests/results/job-2017-10-13T10.44-21b667f/results.html
10:46:34 INFO    : 
10:46:34 INFO    : Summary of test results can be found below:
TestSuite                                                                   TestRun    Summary             
 
guest_install                                                               Run        Successfully executed
/root/hostos/tests/results/job-2017-10-13T10.44-6d9d120/job.log
 
guest_short_sanity                                                          Run        Successfully executed
/root/hostos/tests/results/job-2017-10-13T10.44-21b667f/job.log
10:46:34 INFO    : Removing temporary mux dir
[root@baratheon tests]#

Automate posting Host OS build test results

cde:info Mirrored with LTC bug https://bugzilla.linux.ibm.com/show_bug.cgi?id=170761 </cde:info>

There is an Issue #1 in the open-power-host-os.github.io repo tracking the overall plan to publish and reference the test results for the Host OS weekly builds in Github. The plan is copied below for reference.

This issue is for tracking the additional CI automation necessary to gather the test results files and post them externally to the correct repository.

Overall Plan:

Create static folders in the github.io repo for storage of weekly test results. "Weekly_Build_Test_Results" high level folder and "Latest_Test_Results" sub-folder.
Post the most recent test results HTML and companion files for each weekly build into a subfolder of the static "Weekly_Build_Test_Results" folder with a date/time stamp associated with the build date.
Post the most recent test results files also to the "Latest_Test_Results" static sub-folder (overwrite previous results).
Add text and static links referencing the latest test results from the "Latest_Test_Results" static sub-folder in the github.io README file.

Test Debian-based HostOS Host

Investigate running Host OS tests against a Debian-based Host OS system.

This will remain an investigation item until I discover if/when Host OS build will install on Debian (prerequisite for test support).

cde:info Mirrored with LTC bug #157748 </cde:info>

Future sprint: test bz: [feat] P9 guest - pci-passthr

This is test bz to track the testcases development for below new feature targeted for sprint 1:
144903 [FEATURE] P9 guest - pci-passthru

Mallesh will be test owner.

Mallesh please update with the testcases meant for testing this new feature.

cde:info Mirrored with LTC bug #158310 </cde:info>

Investigate and integrate 4Q2016 Guest VM tests for new Host OS features and regression tests

Investigate and integrate Guest VM tests for applicable new Host OS features and newly automated Host OS regression tests throughout 4th quarter 2016 (4Q2016).

Test Ubuntu-based HostOS Host

Test run Host OS test suite against an Ubuntu-based Host OS. Update code and ReadMe where necessary.

This enhancements depends on the completion of the Host OS builds repository Issue #51.

cde:info Mirrored with LTC bug #157746 </cde:info>

Test Debian HostOS VM

Investigate running Host OS guest tests against a Debian VM/Guest.

cde:info Mirrored with LTC bug #159688 </cde:info>

Add support for Fedora24 guest

Fedora24 guest support

Check base packages and kvm packages

When trying to run on a host (with kvm), only the following kvm packages are checked for.

# python avocado-setup.py 
14:46:32 INFO    : Check for environment
['libvirt-devel', 'tcpdump', 'virt-install', 'qemu-kvm', 'libvirt', 'SLOF', 'genisoimage', '^attr']

Is it supposed to check base + kvm packages?
i.e.

[deps_rhel8.0]
packages = gcc,python2-devel,xz-devel,python2-setuptools,numactl,policycoreutils-python-utils
and
[deps_rhel8.0_kvm]
packages = libvirt-devel,tcpdump,virt-install,qemu-kvm,libvirt,SLOF,genisoimage,^attr

Test Host OS running as Guest

Test install and test runs of Host OS running as a guest on a Host OS base OS.

This may require additional code for the guest install portion and possibly minor bug fixes in a subset of guest test cases.

cde:info Mirrored with LTC bug #157749 </cde:info>

Guest Sanity: Hotplug tests failing

Guest Sanity: Hotplug tests failing

Reason for Failure:
Failures due to ppc64-diag and servicelog package missing in default Fedora23 iso

Testcases affected:
087-guest_sanity.hotplug.disk.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.23.ppc64le.io-github-autotest-libvirt.virsh.attach_detach_disk.attach_disk.normal_test.host_block_vm_id
089-guest_sanity.hotplug.disk.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.23.ppc64le.io-github-autotest-libvirt.virsh.attach_detach_disk.detach_disk.normal_test.host_block_vm_id
091-guest_sanity.hotplug.memory.qemu.qcow2.scsi.smp2.spapr-vlan.Fedora.23.ppc64le.io-github-autotest-libvirt.libvirt_mem.positive_test.hot_plug

Resolution action:
Raised a recommendation for Fedora to ship/have those packages by default.

Workaround:
Install ppc64-diag manually after the installation of guest and then run only these tests with filter
--only-filter "guest_sanity.hotplug"

Sprint 1: test bz: [feat] CPU Hotunplug failed after migration with "error: operation failed: vcpu unplug request timed out"

This is test bz to track the testcases development for below new feature targeted for sprint 1:
151867 [HostOS] [Libvirt] CPU Hotunplug failed after migration with "error: operation failed: vcpu unplug request timed out"

[email protected] will be test owner.

[email protected] please update with the testcases meant for testing this new feature.

cde:info Mirrored with LTC bug #158308 </cde:info>

Investigate creating new "Guest_All" test suite for Guest VM validation

The current default "sanity" test suite to validate the Guest VM has a subset of tests that should be run to ensure the Guest VM is running as expected. There are additional tests available to run that are currently not a part of the smaller sanity test suite.

A new "Guest_All" suite will list all of the currently available tests that can be run against the Guest VM. This full suite will likely take a very long time to run, so I doubt users will run it as-is very often. A very good advantage to this suite is that it will give users a good starting point to customize their own test suite (copy the Guest_All suite and then remove unwanted tests).

Investigate potentially integrating various hardware tests into Host OS Test Suite

Investigate potentially integrating various hardware tests into Host OS Test Suite.

There are multiple test suites available that focus on hardware testing. I will investigate what subset of these suites would be useful to Host OS users and how best to integrate that subset into the current Host OS Test Suite.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.