From 1ab354b2453bce60cd5cd800d87a83fc9e30a0c6 Mon Sep 17 00:00:00 2001 From: Dimitrios Apostolou Date: Tue, 10 May 2022 16:37:19 +0200 Subject: qt-testrunner: Commit forgotten README file Pick-to: 6.4 6.3 6.2 Change-Id: Ie307b95947a6910bd65bb22ecf938fae9de22f9d Reviewed-by: Edward Welbourne --- util/testrunner/README | 24 ++++++++++++++++++++++++ 1 file changed, 24 insertions(+) create mode 100644 util/testrunner/README (limited to 'util') diff --git a/util/testrunner/README b/util/testrunner/README new file mode 100644 index 0000000000..5758e32514 --- /dev/null +++ b/util/testrunner/README @@ -0,0 +1,24 @@ +qt-testrunner.py is a script that can wrap the execution of every test in Qt +in order to iron out common issues with testing. It can be turned on by +setting the environment variable TESTRUNNER=/path/to/qt-testrunner.py before +invoking ctest. + +It is commonly in use in Coin, the Continuous Integration system of Qt. + +It offers the following functionality ++ Reads the XML test log and understands exactly which function of the test failed. ++ Checks the exit code and if needed repeats only the failed function of the test. ++ Appends output argument to it: "-o file.xml" ++ In case the test is executed multiple times + - the previous output files are saved + - the verbosity level is increased + +The script itself has a testsuite that is simply run by invoking + +qtbase/util/testrunner/tests/tst_testrunner.py + +Please *run this manually* before submitting a change to qt-testrunner and +make sure it's passing. The reason it does not run automatically during the +usual qtbase test run, is because ++ the test run should not depend on Python ++ we don't want to wrap the testrunner tests with testrunner. -- cgit v1.2.3