From 1a708277c587031d4d00e095be8251e3893b0c45 Mon Sep 17 00:00:00 2001 From: "Mirko Boehm (AWS)" Date: Thu, 14 Mar 2013 08:32:38 +0100 Subject: Add minimumtotal option to improve accuracy of short-lived benchmarks. Short-lived benchmarks (benchmarks that complete in a very short period of measured time) are often more affected by jitter and warm-up effects than longer running benchmarks. Since QBENCHMARK stores the median result of all accepted benchmark runs, a larger number of aggregation runs is preferable for short-lived tests, but not necessarily for longer running ones. The minimumtotal option, specified in units of the selected measurement, will make the benchmark repeat a benchmark until the total measured cost exceeds the specified threshold. The displayed median result will then tend to be more accurate. This is especially useful for data-driven benchmarks in case the data tags scale the benchmarked operation from little to large cost. Change-Id: Ib857de64aaffc77715a0000d36f0245f31d86b9a Reviewed-by: Jason McDonald --- src/testlib/doc/src/qttestlib-manual.qdoc | 2 ++ 1 file changed, 2 insertions(+) (limited to 'src/testlib/doc') diff --git a/src/testlib/doc/src/qttestlib-manual.qdoc b/src/testlib/doc/src/qttestlib-manual.qdoc index 9d4a34c9d4..c44bb49ae3 100644 --- a/src/testlib/doc/src/qttestlib-manual.qdoc +++ b/src/testlib/doc/src/qttestlib-manual.qdoc @@ -268,6 +268,8 @@ Counts events received during benchmarks. \li \c -minimumvalue \e n \br Sets the minimum acceptable measurement value. + \li \c -minimumtotal \e n \br + Sets the minimum acceptable total for repeated executions of a test function. \li \c -iterations \e n \br Sets the number of accumulation iterations. \li \c -median \e n \br -- cgit v1.2.3