summaryrefslogtreecommitdiffstats
path: root/scripts/README
blob: cfc54fd4d2bfb1b93c8ec960416ca443b198aaad (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
Useful queries that can be applied to the database generated by
the --sqlitedump option to getstats.py:

------------------------------------------------------------------------
Query 1: List all test cases with their average relative standard errors
------------------------------------------------------------------------

sqlite> select testCase, avg(rse) as x from stats group by testCase order by x desc;
tst_GraphicsViewBenchmark|4.56425592578652
tst_QGraphicsView|1.70452950079799
tst_QThreadStorage|1.26334423937767
tst_QScriptValue|0.802017637974722
tst_qregexp|0.660798870257877
tst_QScriptClass|0.618591626001
QObjectBenchmark|0.490495301875798
tst_QMetaType|0.485236373654058
tst_QTraceBench|0.455391506311167
tst_qmetaobject|0.440709668057305
tst_QScriptEngine|0.401089512276
tst_qhostinfo|

To verify the value for tst_QThreadStorage (1.26334423937767), run the
following query to list the individual observations:

sqlite> select testCase, rse from stats where testCase='tst_QThreadStorage';
tst_QThreadStorage|0.20903696306
tst_QThreadStorage|3.36431854834
tst_QThreadStorage|0.216677206733

And verify that
   (0.20903696306 + 3.36431854834 + 0.216677206733) / 3 == 1.26334423937767


--------------------------------------------------------------------------
Query 2: List the test case and relative standard error of all benchmarks
         in aligned columns. Ensure that the rse column is not truncated
         (bug?) by setting the width to 20.
--------------------------------------------------------------------------

$ echo -e ".width 0 20\nselect testCase, rse from stats order by rse desc;" |
sqlite3 -column -header stats.db | less