summaryrefslogtreecommitdiffstats
path: root/util
diff options
context:
space:
mode:
authorDimitrios Apostolou <jimis@qt.io>2022-05-10 16:37:19 +0200
committerDimitrios Apostolou <jimis@qt.io>2022-06-16 21:04:48 +0200
commit1ab354b2453bce60cd5cd800d87a83fc9e30a0c6 (patch)
tree9b0282c74160fb6630369a7d61df6b1f5389946a /util
parent662184ac68803aac553921520a1b4b7b23a0633c (diff)
qt-testrunner: Commit forgotten README file
Pick-to: 6.4 6.3 6.2 Change-Id: Ie307b95947a6910bd65bb22ecf938fae9de22f9d Reviewed-by: Edward Welbourne <edward.welbourne@qt.io>
Diffstat (limited to 'util')
-rw-r--r--util/testrunner/README24
1 files changed, 24 insertions, 0 deletions
diff --git a/util/testrunner/README b/util/testrunner/README
new file mode 100644
index 0000000000..5758e32514
--- /dev/null
+++ b/util/testrunner/README
@@ -0,0 +1,24 @@
+qt-testrunner.py is a script that can wrap the execution of every test in Qt
+in order to iron out common issues with testing. It can be turned on by
+setting the environment variable TESTRUNNER=/path/to/qt-testrunner.py before
+invoking ctest.
+
+It is commonly in use in Coin, the Continuous Integration system of Qt.
+
+It offers the following functionality
++ Reads the XML test log and understands exactly which function of the test failed.
++ Checks the exit code and if needed repeats only the failed function of the test.
++ Appends output argument to it: "-o file.xml"
++ In case the test is executed multiple times
+ - the previous output files are saved
+ - the verbosity level is increased
+
+The script itself has a testsuite that is simply run by invoking
+
+qtbase/util/testrunner/tests/tst_testrunner.py
+
+Please *run this manually* before submitting a change to qt-testrunner and
+make sure it's passing. The reason it does not run automatically during the
+usual qtbase test run, is because
++ the test run should not depend on Python
++ we don't want to wrap the testrunner tests with testrunner.