diff options
| author | Christian Tismer <tismer@stackless.com> | 2017-12-07 14:47:36 +0100 |
|---|---|---|
| committer | Christian Tismer <tismer@stackless.com> | 2017-12-21 15:04:31 +0000 |
| commit | 5c7e140036e26d8dad27ef8b7da984f093e97787 (patch) | |
| tree | 2af91f5f903be5a6ca8ea5d1b885ea6dc6c362b7 /testing/parser.py | |
| parent | 5f59ce344ffb1086b74e34fa24257b87d9325cd2 (diff) | |
testrunner 5: Improve the algorithm
Testrunner checks if it is running in COIN.
If so, it runs each tested project 5 times and reports an error if
3 errors were found in a test function and not blacklisted.
The time is measured, so we know if we can run all the tests five
times or if we can run only the failed tests.
At the moment, the option COIN_RERUN_FAILED_ONLY is activated
by default. We can configure it by setting to false.
Since this change turns the registry existence test into a flaky test
(te tests generates it's missing file in the first run),
the registry existence test is no more blacklisted.
We simulate our own tee command now with decorated output.
Task-number: PYSIDE-578
Change-Id: I6390cd50398a97a168c85c6bb778984c6a5b90fc
Reviewed-by: Friedemann Kleint <Friedemann.Kleint@qt.io>
Diffstat (limited to 'testing/parser.py')
| -rw-r--r-- | testing/parser.py | 2 |
1 files changed, 0 insertions, 2 deletions
diff --git a/testing/parser.py b/testing/parser.py index 6c0d2af6f..d54abb1fa 100644 --- a/testing/parser.py +++ b/testing/parser.py @@ -114,8 +114,6 @@ def _parse_tests(test_log): idx, n, sharp, mod_name, much_stuff, code1, code2, tim = tup = match.groups() # either code1 or code2 is None code = code1 or code2 - if idx != sharp: - raise ValueError("inconsistent log lines or program error: %s" % tup) idx, n, code, tim = int(idx), int(n), code.lower(), float(tim) res = TestResult(idx, mod_name, code == "passed", code, tim) result.append(res) |