Useful queries that can be applied to the database generated by the --sqlitedump option to getstats.py: ------------------------------------------------------------------------ Query 1: List all test cases with their average relative standard errors ------------------------------------------------------------------------ sqlite> select testCase, avg(rse) as x from stats group by testCase order by x desc; tst_GraphicsViewBenchmark|4.56425592578652 tst_QGraphicsView|1.70452950079799 tst_QThreadStorage|1.26334423937767 tst_QScriptValue|0.802017637974722 tst_qregexp|0.660798870257877 tst_QScriptClass|0.618591626001 QObjectBenchmark|0.490495301875798 tst_QMetaType|0.485236373654058 tst_QTraceBench|0.455391506311167 tst_qmetaobject|0.440709668057305 tst_QScriptEngine|0.401089512276 tst_qhostinfo| To verify the value for tst_QThreadStorage (1.26334423937767), run the following query to list the individual observations: sqlite> select testCase, rse from stats where testCase='tst_QThreadStorage'; tst_QThreadStorage|0.20903696306 tst_QThreadStorage|3.36431854834 tst_QThreadStorage|0.216677206733 And verify that (0.20903696306 + 3.36431854834 + 0.216677206733) / 3 == 1.26334423937767 -------------------------------------------------------------------------- Query 2: List the test case and relative standard error of all benchmarks in aligned columns. Ensure that the rse column is not truncated (bug?) by setting the width to 20. -------------------------------------------------------------------------- $ echo -e ".width 0 20\nselect testCase, rse from stats order by rse desc;" | sqlite3 -column -header stats.db | less