path: root/testrunner.py
Commit message (Collapse)AuthorAgeFilesLines
* Change license from all the filesCristian Maureira-Fredes2018-05-031-1/+1
| | | | | | | | | | | | | | | | | Removing the word 'project' from all the headers, and changing the PySide reference from the examples to Qt for Python: The following line was used inside the source/ and build_scripts/ directory: for i in $(grep -r "the Qt for Python project" * |grep -v "pyside2-tools" | awk '{print $1}' | sed 's/:.*//g');do sed -i 's/the\ Qt\ for\ Python\ project/Qt\ for\ Python/g' $i;done and the following line was used inside the examples/ directory: for i in $(grep -r "of the PySide" * |grep -v "pyside2-tools" | awk '{print $1}' | sed 's/:.*//g');do sed -i 's/of\ the\ PySide/of\ the\ Qt\ for\ Python/g' $i;done Change-Id: Ic480714686ad62ac4d81c670f87f1c2033d4ffa1 Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io> Reviewed-by: Alex Blasche <alexander.blasche@qt.io>
* testrunner 1: Turn into a packageChristian Tismer2017-12-211-787/+4
| | | | | | | | | | | | | Testrunner is a medium-large module that has a number of different purposes. Since we want to improve the testing logic, it is better to clean the module up before adding even more code. For compatibitity, the testrunner module will stay in place, but redirect everything into the new "testing" package. Task-number: PYSIDE-578 Change-Id: I3d14f3c4c421cdd2bb7777691b56677aa4786dd8 Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
* Fix testrunner to parse blacklist correctly on Qt5.xx.yChristian Tismer2017-11-301-12/+4
| | | | | | | | | | | | | testrunner had a simple extension that propagated classifiers like Qt5.6.4 to Qt5.6 and Qt5. This extension was not able to recognize Qt5.11.0 . It was a known omission in testrunner.py that was commented but ignored in the reviews. (#35 on 2016-09-16 and #42 on 2016-09-22) This patch corrects that omission. Change-Id: I0b17c40b46af0572123a503a83db115b488bb87a Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
* Testrunner.py: Output environment and some information from sysFriedemann Kleint2017-11-241-0/+5
| | | | | | Task-number: PYSIDE-431 Change-Id: I55d8a1b71ed23fd887e2d65a34a6dc0b48568c07 Reviewed-by: Christian Tismer <tismer@stackless.com>
* Fix testrunner.py in winSimo Fält2017-06-211-1/+9
| | | | | | | | The official git setup recommends to add only git.cmd to win PATH if ran in native CMD. Change-Id: I370752bf0d052f8047e929639b3246b726131b5a Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
* testrunner.py: Add default value for blacklistFriedemann Kleint2017-03-291-1/+3
| | | | | | | Saves some typing and makes COIN integration easier. Change-Id: Ic7b302157dd5b53388ccc7b89f70db5635bb3ba8 Reviewed-by: Christian Tismer <tismer@stackless.com>
* Fix output of testrunner.py and remove ’six’Christian Tismer2017-03-131-3/+3
| | | | | | | | | There is a small error that reports the wrong total number of changes. Furthermore, the dependency of the six modure could be removed by a single line. Change-Id: I510eab49ae3b9c5c36a7ae31a982334fda18567d Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
* Fix testrunner command “getcwd”Christian Tismer2017-02-101-2/+2
| | | | | | | | | | | The testrunner.py script was generalisation to allow to select older build versions. (This feature is not ready and in most cases it makes only sense when comparing python 2 and 3.) I had a wrong argument in “getcwd”. Fixed. Change-Id: Ic948a5a6649535bd6ad3d23bbc846f03bde82de0 Reviewed-by: Simo Fält <simo.falt@qt.io>
* Enable testrunner for other projectsChristian Tismer2016-12-151-35/+65
| | | | | | | | | | | | | | | | | | | | Testrunner did only run the pyside2 tests. This new version also allows to specify the projects “shiboken2” and “pyside2-tools”. Now multiple tests can be specified. Interesting: All shiboken2 tests succeed, all pyside2-tools tests fail. Update: the pyside-tools tests work too, but the setup does not work automatically, yet. A “make” must be run in the pyside2-tools directory, and “pyside2-rcc -o example_rc.py example.qrc” must be run in order to generate a resource file. The tests are run according to a list. The default is currently “—projects=shiboken2 pyside2”. Change-Id: I69f08402de0956098aaca5553f98ce50cbf6eae5 Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
* testrunner.py: Use 'linux' as classifier instead of legacy 'linux2'Friedemann Kleint2016-12-131-3/+5
| | | | | | | | | Python 2.X returns 'linux2' as platform for compatibility reasons regardless of the kernel version whereas Python 3.3 onwards returns 'linux'. Fixes blacklisting to work with newer versions of Python. Change-Id: I1d3fd72feaa42bd5c89fa10a9a73474a92a6ab53 Reviewed-by: Christian Tismer <tismer@stackless.com>
* testrunner.py: Allow character '-' in test namesFriedemann Kleint2016-11-291-2/+2
| | | | | | | | | | | | | | | The script was mistakenly reporting FAIL : QtCore::bug_PYSIDE() for FAIL : QtCore::bug_PYSIDE-164() Fix by extending the regular expression. Change-Id: Id6ca4c75489bd577e25723efd62840f714e67ae4 Reviewed-by: Christian Tismer <tismer@stackless.com>
* Support multiple builds in testrunner.pyChristian Tismer2016-11-241-23/+51
| | | | | | | | | | | | | | | | | | The testrunner module allowed only the last build to be tested. This patch allows to specify an arbitrary test index. The default is -1, which gives the normal behavior. The argument ‘—buildno’ specifies which build is to be selected. Note that multiple builds with the same directory are not valid, because the latest entry always overwrites the older ones. But for different configurations this makes sense. The default runtime was set to 600 s. Change-Id: Ib5b33a09dc0af7e36230ca4eba3c21c8970d8212 Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io> Reviewed-by: Alexandru Croitor <alexandru.croitor@qt.io>
* Accept more errors in "testrunner.py"Christian Tismer2016-11-031-1/+1
| | | | | | | | Testrunner has even more variable texts to recognize. We change the regex slightly so that it always succeeds. Change-Id: Iac156592aac48afb5aea522540ae63c92ca2572a Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
* Fix licenses of setup.py testrunner.pyFriedemann Kleint2016-10-121-19/+38
| | | | | Change-Id: I049929e2c4e24554866000df5daa063071060884 Reviewed-by: Lars Knoll <lars.knoll@qt.io>
* fix testing with filtering on real CIChristian Tismer2016-09-301-6/+30
| | | | | | | | | | | | | | | There are a couple of effects when running testrunner.py in real life. Fix: It reports success when there are no tests found. Fix and extend the recognition of relative paths. Add a "getcwd" sub-command to get external access to the build folder. The make command uses no longer "-C" for easier environ access. Change-Id: Iee2f81ed762b9773021055d26f9b144c31acbe35 Reviewed-by: Alexandru Croitor <alexandru.croitor@qt.io>
* support pyside CI testing with filteringChristian Tismer2016-09-221-0/+719
PySide is currently in an unfinished state. Therefore, running all the tests will never return a success. To make this more useful, this script is controlled by a blacklist, in order to keep record of the known-to-fail tests. On success: zero error status On Failure: nonzero (raises ValueError) The test parser uses a blacklist file that is compatible to standard Qt blacklist files. macOS, Ubuntu and windows (thanks to fkleint) are supported. The blacklist has a feature where new configurations are learned. It first removes old versions of the same tests, before it inserts the new ones. Blacklisting is now optional. We support now py2, py3, qt5, qt5.6 etc. Some consideration about collapsing the data are added. The parser has now a sub-command "test" that is mandatory. Support for moving the build_dir to another location without loosing the tests so far. Implement BPASS. Support CTEST_OUTPUT_ON_FAILURE Change-Id: If66d3cf1733a3b0c8a47fe9b8c6aec8ea430c699 Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>