Hello hackers,
I've repeated the performance measurement for REL_17_STABLE (1e020258e)
and REL_16_STABLE (6f6b0f193) and found several benchmarks where v16 is
significantly better than v17. Please find attached an html table with
all the benchmarking results.
I had payed attention to:
Best pg-src-17--.* worse than pg-src-16--.* by 57.9 percents (225.11 > 142.52):
pg_tpcds.query15
Average pg-src-17--.* worse than pg-src-16--.* by 55.5 percents (230.57 >
148.29): pg_tpcds.query15
in May, performed `git bisect` for this degradation, that led me to commit
b7b0f3f27 [1].
This time I bisected the following anomaly:
Best pg-src-17--.* worse than pg-src-16--.* by 23.6 percents (192.25 > 155.58):
pg_tpcds.query21
Average pg-src-17--.* worse than pg-src-16--.* by 25.1 percents (196.19 >
156.85): pg_tpcds.query21
and to my surprise I got "b7b0f3f27 is the first bad commit".
Moreover, bisecting of another anomaly:
Best pg-src-17--.* worse than pg-src-16--.* by 24.2 percents (24269.21 >
19539.89): pg_tpcds.query72
Average pg-src-17--.* worse than pg-src-16--.* by 24.2 percents (24517.66 >
19740.12): pg_tpcds.query72
pointed at the same commit again.
So it looks like q15 from TPC-DS is not the only query suffering from that
change.
But beside that, I've found a separate regression. Bisecting for this
degradation:
Best pg-src-17--.* worse than pg-src-16--.* by 105.0 percents (356.63 >
173.96): s64da_tpcds.query95
Average pg-src-17--.* worse than pg-src-16--.* by 105.2 percents (357.79 >
174.38): s64da_tpcds.query95
pointed at f7816aec2.
Does this deserve more analysis and maybe fixing?
[1]
https://www.postgresql.org/message-id/63a63690-dd92-c809-0b47-af05459e95d1%40gmail.com
Best regards,
Alexander
./analyze-benchmarks.py -i 'pg-src-17--.*' 'pg-src-16--.*'
Best pg-src-17--.* better than pg-src-16--.* by 5.3 percents (9.04 < 9.55):
pg_tpch.query1
Average pg-src-17--.* better than pg-src-16--.* by 5.8 percents (9.05 < 9.61):
pg_tpch.query1
Best pg-src-17--.* better than pg-src-16--.* by 5.3 percents (2.84 < 3.00):
pg_tpch.query3
Average pg-src-17--.* better than pg-src-16--.* by 5.7 percents (2.85 < 3.02):
pg_tpch.query3
Best pg-src-17--.* better than pg-src-16--.* by 8.2 percents (1.35 < 1.47):
pg_tpch.query6
Average pg-src-17--.* better than pg-src-16--.* by 7.5 percents (1.36 < 1.47):
pg_tpch.query6
Best pg-src-17--.* worse than pg-src-16--.* by 5.9 percents (0.90 > 0.85):
pg_tpch.query9
Best pg-src-17--.* better than pg-src-16--.* by 8.2 percents (2.58 < 2.81):
pg_tpch.query13
Average pg-src-17--.* better than pg-src-16--.* by 5.9 percents (2.66 < 2.83):
pg_tpch.query13
Best pg-src-17--.* better than pg-src-16--.* by 6.2 percents (3.02 < 3.22):
pg_tpch.query15
Average pg-src-17--.* better than pg-src-16--.* by 6.1 percents (3.03 < 3.23):
pg_tpch.query15
Best pg-src-17--.* better than pg-src-16--.* by 5.6 percents (8.14 < 8.62):
pg_tpch.query17
Average pg-src-17--.* better than pg-src-16--.* by 5.2 percents (8.18 < 8.63):
pg_tpch.query17
Best pg-src-17--.* better than pg-src-16--.* by 5.3 percents (0.18 < 0.19):
pg_tpch.query19
Best pg-src-17--.* better than pg-src-16--.* by 18.6 percents (4.81 < 5.91):
pg_tpch.query20
Average pg-src-17--.* better than pg-src-16--.* by 10.6 percents (5.30 < 5.93):
pg_tpch.query20
Best pg-src-17--.* better than pg-src-16--.* by 5.9 percents (2.07 < 2.20):
pg_tpcds.vacuum_freeze_time
Average pg-src-17--.* better than pg-src-16--.* by 5.9 percents (2.08 < 2.21):
pg_tpcds.vacuum_freeze_time
Best pg-src-17--.* better than pg-src-16--.* by 6.9 percents (73.31 < 78.77):
pg_tpcds.query92
Average pg-src-17--.* better than pg-src-16--.* by 7.2 percents (74.12 <
79.90): pg_tpcds.query92
Best pg-src-17--.* better than pg-src-16--.* by 6.3 percents (600.38 < 640.59):
pg_tpcds.query13
Average pg-src-17--.* better than pg-src-16--.* by 6.0 percents (604.42 <
643.14): pg_tpcds.query13
Best pg-src-17--.* better than pg-src-16--.* by 7.3 percents (1324.73 <
1429.52): pg_tpcds.query9
Average pg-src-17--.* better than pg-src-16--.* by 7.3 percents (1327.16 <
1431.45): pg_tpcds.query9
Best pg-src-17--.* worse than pg-src-16--.* by 23.6 percents (192.25 > 155.58):
pg_tpcds.query21
Average pg-src-17--.* worse than pg-src-16--.* by 25.1 percents (196.19 >
156.85): pg_tpcds.query21
Best pg-src-17--.* better than pg-src-16--.* by 7.1 percents (4.35 < 4.68):
pg_tpcds.query93
Best pg-src-17--.* worse than pg-src-16--.* by 54.3 percents (145.53 > 94.31):
pg_tpcds.query16
Average pg-src-17--.* worse than pg-src-16--.* by 50.0 percents (146.84 >
97.87): pg_tpcds.query16
Best pg-src-17--.* better than pg-src-16--.* by 5.8 percents (250.23 < 265.52):
pg_tpcds.query68
Best pg-src-17--.* better than pg-src-16--.* by 5.8 percents (7.38 < 7.83):
pg_tpcds.query37
Average pg-src-17--.* worse than pg-src-16--.* by 19.4 percents (9.50 > 7.95):
pg_tpcds.query37
Best pg-src-17--.* worse than pg-src-16--.* by 24.2 percents (24269.21 >
19539.89): pg_tpcds.query72
Average pg-src-17--.* worse than pg-src-16--.* by 24.2 percents (24517.66 >
19740.12): pg_tpcds.query72
Best pg-src-17--.* better than pg-src-16--.* by 8.2 percents (9.02 < 9.83):
pg_tpcds.query82
Average pg-src-17--.* better than pg-src-16--.* by 10.5 percents (9.07 <
10.14): pg_tpcds.query82
Best pg-src-17--.* better than pg-src-16--.* by 5.6 percents (323.83 < 343.15):
pg_tpcds.query79
Average pg-src-17--.* better than pg-src-16--.* by 5.6 percents (324.64 <
343.99): pg_tpcds.query79
Best pg-src-17--.* worse than pg-src-16--.* by 35.5 percents (403.55 > 297.75):
pg_tpcds.query66
Average pg-src-17--.* worse than pg-src-16--.* by 41.1 percents (422.05 >
299.08): pg_tpcds.query66
Best pg-src-17--.* better than pg-src-16--.* by 7.5 percents (220.67 < 238.64):
pg_tpcds.query71
Average pg-src-17--.* better than pg-src-16--.* by 7.0 percents (223.50 <
240.26): pg_tpcds.query71
Best pg-src-17--.* better than pg-src-16--.* by 6.8 percents (227.44 < 244.09):
pg_tpcds.query34
Average pg-src-17--.* better than pg-src-16--.* by 7.2 percents (227.69 <
245.44): pg_tpcds.query34
Best pg-src-17--.* worse than pg-src-16--.* by 57.9 percents (225.11 > 142.52):
pg_tpcds.query15
Average pg-src-17--.* worse than pg-src-16--.* by 55.5 percents (230.57 >
148.29): pg_tpcds.query15
Average pg-src-17--.* better than pg-src-16--.* by 15.9 percents (113.49 <
135.01): pg_tpcds.query85
Average pg-src-17--.* better than pg-src-16--.* by 5.0 percents (14.58 <
15.36): pg_tpcds.query84
Best pg-src-17--.* better than pg-src-16--.* by 9.4 percents (180.90 < 199.68):
pg_tpcds.query73
Average pg-src-17--.* better than pg-src-16--.* by 9.4 percents (183.83 <
202.82): pg_tpcds.query73
Best pg-src-17--.* better than pg-src-16--.* by 6.6 percents (68.85 < 73.68):
pg_tpcds.query94
Average pg-src-17--.* better than pg-src-16--.* by 6.6 percents (69.29 <
74.16): pg_tpcds.query94
Best pg-src-17--.* better than pg-src-16--.* by 8.7 percents (1512.23 <
1656.22): pg_tpcds.query88
Average pg-src-17--.* better than pg-src-16--.* by 8.6 percents (1519.79 <
1663.64): pg_tpcds.query88
Best pg-src-17--.* worse than pg-src-16--.* by 26.1 percents (93.39 > 74.08):
pg_tpcds.query40
Average pg-src-17--.* worse than pg-src-16--.* by 28.7 percents (95.86 >
74.49): pg_tpcds.query40
Best pg-src-17--.* worse than pg-src-16--.* by 67.5 percents (942.11 > 562.38):
pg_tpcds.query26
Average pg-src-17--.* worse than pg-src-16--.* by 70.3 percents (970.99 >
570.10): pg_tpcds.query26
Best pg-src-17--.* better than pg-src-16--.* by 9.9 percents (181.90 < 201.92):
pg_tpcds.query96
Average pg-src-17--.* better than pg-src-16--.* by 9.4 percents (183.38 <
202.39): pg_tpcds.query96
Best pg-src-17--.* better than pg-src-16--.* by 25.3 percents (16891.29 <
22604.77): pg_tpcds.query6
Average pg-src-17--.* better than pg-src-16--.* by 25.3 percents (16918.31 <
22639.03): pg_tpcds.query6
Average pg-src-17--.* worse than pg-src-16--.* by 7.4 percents (7511.00 >
6990.67): ycsb.load_a_10_runtime
Best pg-src-17--.* worse than pg-src-16--.* by 5.4 percents (5420.00 >
5144.00): ycsb.load_a_25_runtime
Average pg-src-17--.* worse than pg-src-16--.* by 5.4 percents (5445.67 >
5165.67): ycsb.load_a_25_runtime
Best pg-src-17--.* worse than pg-src-16--.* by 8.8 percents (5678.00 >
5218.00): ycsb.load_a_50_runtime
Average pg-src-17--.* worse than pg-src-16--.* by 8.9 percents (5753.33 >
5283.33): ycsb.load_a_50_runtime
Best pg-src-17--.* worse than pg-src-16--.* by 27.1 percents (8367.00 >
6583.00): ycsb.load_f_25_runtime
Average pg-src-17--.* worse than pg-src-16--.* by 30.8 percents (8742.00 >
6681.67): ycsb.load_f_25_runtime
Average pg-src-17--.* worse than pg-src-16--.* by 6.7 percents (133435.60 <
143084.60): ycsb.load_a_10_ops
Best pg-src-17--.* worse than pg-src-16--.* by 5.1 percents (184501.85 <
194401.24): ycsb.load_a_25_ops
Average pg-src-17--.* worse than pg-src-16--.* by 5.1 percents (183634.52 <
193587.66): ycsb.load_a_25_ops
Best pg-src-17--.* worse than pg-src-16--.* by 8.1 percents (176118.35 <
191644.31): ycsb.load_a_50_ops
Average pg-src-17--.* worse than pg-src-16--.* by 8.2 percents (173829.60 <
189313.98): ycsb.load_a_50_ops
Best pg-src-17--.* worse than pg-src-16--.* by 21.3 percents (119517.15 <
151906.43): ycsb.load_f_25_ops
Average pg-src-17--.* worse than pg-src-16--.* by 23.5 percents (114531.59 <
149688.38): ycsb.load_f_25_ops
Best pg-src-17--.* better than pg-src-16--.* by 6.4 percents (221078.00 >
207779.00): benchmarksql_tpcc.tpm_total
Best pg-src-17--.* better than pg-src-16--.* by 6.4 percents (663290.00 >
623364.00): benchmarksql_tpcc.xacts
Best pg-src-17--.* better than pg-src-16--.* by 10.2 percents (88936.33 >
80739.14): benchbase.epinions_rps
Average pg-src-17--.* better than pg-src-16--.* by 10.2 percents (88054.96 >
79928.53): benchbase.epinions_rps
Best pg-src-17--.* better than pg-src-16--.* by 6.1 percents (7867.24 >
7417.44): benchbase.otmetrics_rps
Average pg-src-17--.* worse than pg-src-16--.* by 10.8 percents (1.04 < 1.17):
benchbase.resourcestresser_rps
Best pg-src-17--.* better than pg-src-16--.* by 6.1 percents (51916.29 >
48945.04): benchbase.sibench_rps
Best pg-src-17--.* worse than pg-src-16--.* by 5.9 percents (36142.02 <
38390.82): benchbase.smallbank_rps
Average pg-src-17--.* worse than pg-src-16--.* by 7.4 percents (6650.77 <
7178.62): benchbase.tpcc_rps
Best pg-src-17--.* better than pg-src-16--.* by 8.1 percents (18518.52 >
17123.29): gdprbench.load_controller_ops
Average pg-src-17--.* better than pg-src-16--.* by 7.5 percents (17680.79 >
16441.86): gdprbench.load_controller_ops
Best pg-src-17--.* worse than pg-src-16--.* by 9.5 percents (17605.63 <
19455.25): gdprbench.load_customer_ops
Average pg-src-17--.* worse than pg-src-16--.* by 5.7 percents (17382.96 <
18429.87): gdprbench.load_customer_ops
Best pg-src-17--.* better than pg-src-16--.* by 12.8 percents (19455.25 >
17241.38): gdprbench.load_processor_ops
Average pg-src-17--.* better than pg-src-16--.* by 7.2 percents (17522.88 >
16340.23): gdprbench.load_processor_ops
Best pg-src-17--.* better than pg-src-16--.* by 5.3 percents (8.63 < 9.11):
s64da_tpch.query1
Average pg-src-17--.* better than pg-src-16--.* by 5.2 percents (8.68 < 9.16):
s64da_tpch.query1
Best pg-src-17--.* better than pg-src-16--.* by 6.1 percents (2.75 < 2.93):
s64da_tpch.query3
Best pg-src-17--.* better than pg-src-16--.* by 9.0 percents (1.52 < 1.67):
s64da_tpch.query5
Average pg-src-17--.* better than pg-src-16--.* by 8.7 percents (1.54 < 1.68):
s64da_tpch.query5
Best pg-src-17--.* better than pg-src-16--.* by 8.0 percents (1.26 < 1.37):
s64da_tpch.query6
Average pg-src-17--.* better than pg-src-16--.* by 8.0 percents (1.26 < 1.37):
s64da_tpch.query6
Best pg-src-17--.* better than pg-src-16--.* by 6.8 percents (1.79 < 1.92):
s64da_tpch.query7
Average pg-src-17--.* better than pg-src-16--.* by 6.7 percents (1.80 < 1.93):
s64da_tpch.query7
Best pg-src-17--.* better than pg-src-16--.* by 5.3 percents (2.15 < 2.27):
s64da_tpch.query10
Average pg-src-17--.* better than pg-src-16--.* by 5.3 percents (2.16 < 2.28):
s64da_tpch.query10
Best pg-src-17--.* better than pg-src-16--.* by 8.4 percents (1.41 < 1.54):
s64da_tpch.query15
Average pg-src-17--.* better than pg-src-16--.* by 8.2 percents (1.42 < 1.55):
s64da_tpch.query15
Best pg-src-17--.* worse than pg-src-16--.* by 41.0 percents (3815.80 >
2706.73): s64da_tpcds.total
Average pg-src-17--.* worse than pg-src-16--.* by 41.0 percents (3817.55 >
2707.79): s64da_tpcds.total
Best pg-src-17--.* better than pg-src-16--.* by 16.7 percents (0.05 < 0.06):
s64da_tpcds.query8
Average pg-src-17--.* better than pg-src-16--.* by 5.3 percents (0.06 < 0.06):
s64da_tpcds.query8
Best pg-src-17--.* better than pg-src-16--.* by 6.3 percents (2.37 < 2.53):
s64da_tpcds.query9
Average pg-src-17--.* better than pg-src-16--.* by 6.0 percents (2.39 < 2.54):
s64da_tpcds.query9
Best pg-src-17--.* better than pg-src-16--.* by 6.2 percents (0.61 < 0.65):
s64da_tpcds.query13
Average pg-src-17--.* better than pg-src-16--.* by 6.2 percents (0.61 < 0.65):
s64da_tpcds.query13
Best pg-src-17--.* worse than pg-src-16--.* by 64.3 percents (0.23 > 0.14):
s64da_tpcds.query15
Average pg-src-17--.* worse than pg-src-16--.* by 64.3 percents (0.23 > 0.14):
s64da_tpcds.query15
Best pg-src-17--.* worse than pg-src-16--.* by 33.3 percents (0.12 > 0.09):
s64da_tpcds.query16
Average pg-src-17--.* worse than pg-src-16--.* by 33.3 percents (0.12 > 0.09):
s64da_tpcds.query16
Best pg-src-17--.* worse than pg-src-16--.* by 43.5 percents (0.99 > 0.69):
s64da_tpcds.query18
Average pg-src-17--.* worse than pg-src-16--.* by 42.9 percents (1.00 > 0.70):
s64da_tpcds.query18
Average pg-src-17--.* worse than pg-src-16--.* by 9.1 percents (0.28 > 0.26):
s64da_tpcds.query19
Best pg-src-17--.* worse than pg-src-16--.* by 66.7 percents (0.20 > 0.12):
s64da_tpcds.query21
Average pg-src-17--.* worse than pg-src-16--.* by 66.7 percents (0.20 > 0.12):
s64da_tpcds.query21
Average pg-src-17--.* better than pg-src-16--.* by 5.0 percents (4.46 < 4.70):
s64da_tpcds.query22
Best pg-src-17--.* worse than pg-src-16--.* by 48.2 percents (0.83 > 0.56):
s64da_tpcds.query26
Average pg-src-17--.* worse than pg-src-16--.* by 46.5 percents (0.84 > 0.57):
s64da_tpcds.query26
Best pg-src-17--.* better than pg-src-16--.* by 6.6 percents (1.83 < 1.96):
s64da_tpcds.query28
Average pg-src-17--.* better than pg-src-16--.* by 6.9 percents (1.84 < 1.98):
s64da_tpcds.query28
Average pg-src-17--.* worse than pg-src-16--.* by 13.3 percents (0.06 > 0.05):
s64da_tpcds.query32
Best pg-src-17--.* worse than pg-src-16--.* by 9.5 percents (0.23 > 0.21):
s64da_tpcds.query33
Average pg-src-17--.* worse than pg-src-16--.* by 8.0 percents (0.27 > 0.25):
s64da_tpcds.query33
Best pg-src-17--.* better than pg-src-16--.* by 8.0 percents (0.23 < 0.25):
s64da_tpcds.query34
Average pg-src-17--.* better than pg-src-16--.* by 8.0 percents (0.23 < 0.25):
s64da_tpcds.query34
Best pg-src-17--.* better than pg-src-16--.* by 9.4 percents (3.85 < 4.25):
s64da_tpcds.query39a
Average pg-src-17--.* better than pg-src-16--.* by 9.4 percents (3.87 < 4.27):
s64da_tpcds.query39a
Best pg-src-17--.* better than pg-src-16--.* by 8.3 percents (3.89 < 4.24):
s64da_tpcds.query39b
Average pg-src-17--.* better than pg-src-16--.* by 8.8 percents (3.91 < 4.29):
s64da_tpcds.query39b
Best pg-src-17--.* worse than pg-src-16--.* by 37.5 percents (0.11 > 0.08):
s64da_tpcds.query40
Average pg-src-17--.* worse than pg-src-16--.* by 45.8 percents (0.12 > 0.08):
s64da_tpcds.query40
Best pg-src-17--.* worse than pg-src-16--.* by 807.1 percents (1.27 > 0.14):
s64da_tpcds.query45
Average pg-src-17--.* worse than pg-src-16--.* by 42.5 percents (1.27 > 0.89):
s64da_tpcds.query45
Best pg-src-17--.* worse than pg-src-16--.* by 5.5 percents (2.29 > 2.17):
s64da_tpcds.query47
Average pg-src-17--.* worse than pg-src-16--.* by 5.5 percents (2.30 > 2.18):
s64da_tpcds.query47
Best pg-src-17--.* better than pg-src-16--.* by 6.3 percents (0.15 < 0.16):
s64da_tpcds.query49
Average pg-src-17--.* better than pg-src-16--.* by 10.0 percents (0.06 < 0.07):
s64da_tpcds.query50
Best pg-src-17--.* better than pg-src-16--.* by 7.7 percents (2.40 < 2.60):
s64da_tpcds.query51
Average pg-src-17--.* better than pg-src-16--.* by 7.4 percents (2.41 < 2.61):
s64da_tpcds.query51
Best pg-src-17--.* better than pg-src-16--.* by 6.9 percents (0.27 < 0.29):
s64da_tpcds.query52
Average pg-src-17--.* worse than pg-src-16--.* by 6.8 percents (0.26 > 0.24):
s64da_tpcds.query55
Best pg-src-17--.* worse than pg-src-16--.* by 29.4 percents (1.41 > 1.09):
s64da_tpcds.query57
Average pg-src-17--.* worse than pg-src-16--.* by 36.6 percents (1.49 > 1.09):
s64da_tpcds.query57
Best pg-src-17--.* better than pg-src-16--.* by 14.0 percents (1.35 < 1.57):
s64da_tpcds.query59
Average pg-src-17--.* better than pg-src-16--.* by 14.1 percents (1.36 < 1.58):
s64da_tpcds.query59
Best pg-src-17--.* better than pg-src-16--.* by 9.1 percents (0.20 < 0.22):
s64da_tpcds.query62
Average pg-src-17--.* better than pg-src-16--.* by 6.1 percents (0.21 < 0.22):
s64da_tpcds.query62
Best pg-src-17--.* better than pg-src-16--.* by 6.8 percents (1.36 < 1.46):
s64da_tpcds.query65
Average pg-src-17--.* better than pg-src-16--.* by 7.1 percents (1.36 < 1.46):
s64da_tpcds.query65
Best pg-src-17--.* worse than pg-src-16--.* by 34.5 percents (0.39 > 0.29):
s64da_tpcds.query66
Average pg-src-17--.* worse than pg-src-16--.* by 33.7 percents (0.40 > 0.30):
s64da_tpcds.query66
Best pg-src-17--.* better than pg-src-16--.* by 8.7 percents (0.21 < 0.23):
s64da_tpcds.query68
Average pg-src-17--.* better than pg-src-16--.* by 8.7 percents (0.21 < 0.23):
s64da_tpcds.query68
Best pg-src-17--.* better than pg-src-16--.* by 7.1 percents (0.13 < 0.14):
s64da_tpcds.query69
Best pg-src-17--.* better than pg-src-16--.* by 5.3 percents (1.07 < 1.13):
s64da_tpcds.query70
Average pg-src-17--.* worse than pg-src-16--.* by 12.7 percents (0.21 > 0.18):
s64da_tpcds.query71
Best pg-src-17--.* worse than pg-src-16--.* by 22.1 percents (25.05 > 20.52):
s64da_tpcds.query72
Average pg-src-17--.* worse than pg-src-16--.* by 21.0 percents (25.30 >
20.91): s64da_tpcds.query72
Best pg-src-17--.* better than pg-src-16--.* by 9.5 percents (0.19 < 0.21):
s64da_tpcds.query73
Average pg-src-17--.* better than pg-src-16--.* by 9.5 percents (0.19 < 0.21):
s64da_tpcds.query73
Best pg-src-17--.* better than pg-src-16--.* by 9.4 percents (1.84 < 2.03):
s64da_tpcds.query75
Average pg-src-17--.* better than pg-src-16--.* by 9.2 percents (1.85 < 2.04):
s64da_tpcds.query75
Best pg-src-17--.* worse than pg-src-16--.* by 9.4 percents (3.04 > 2.78):
s64da_tpcds.query78
Average pg-src-17--.* worse than pg-src-16--.* by 13.4 percents (3.19 > 2.81):
s64da_tpcds.query78
Best pg-src-17--.* better than pg-src-16--.* by 5.1 percents (0.37 < 0.39):
s64da_tpcds.query79
Average pg-src-17--.* better than pg-src-16--.* by 5.1 percents (0.37 < 0.39):
s64da_tpcds.query79
Best pg-src-17--.* better than pg-src-16--.* by 8.9 percents (1.54 < 1.69):
s64da_tpcds.query88
Average pg-src-17--.* better than pg-src-16--.* by 8.3 percents (1.55 < 1.69):
s64da_tpcds.query88
Best pg-src-17--.* better than pg-src-16--.* by 8.3 percents (0.33 < 0.36):
s64da_tpcds.query89
Average pg-src-17--.* better than pg-src-16--.* by 6.5 percents (0.34 < 0.36):
s64da_tpcds.query89
Best pg-src-17--.* better than pg-src-16--.* by 6.7 percents (0.14 < 0.15):
s64da_tpcds.query90
Average pg-src-17--.* better than pg-src-16--.* by 6.7 percents (0.14 < 0.15):
s64da_tpcds.query90
Best pg-src-17--.* worse than pg-src-16--.* by 25.0 percents (0.05 > 0.04):
s64da_tpcds.query91
Average pg-src-17--.* worse than pg-src-16--.* by 15.4 percents (0.05 > 0.04):
s64da_tpcds.query91
Best pg-src-17--.* better than pg-src-16--.* by 14.3 percents (0.06 < 0.07):
s64da_tpcds.query92
Average pg-src-17--.* better than pg-src-16--.* by 18.2 percents (0.06 < 0.07):
s64da_tpcds.query92
Best pg-src-17--.* worse than pg-src-16--.* by 105.0 percents (356.63 >
173.96): s64da_tpcds.query95
Average pg-src-17--.* worse than pg-src-16--.* by 105.2 percents (357.79 >
174.38): s64da_tpcds.query95
Best pg-src-17--.* better than pg-src-16--.* by 9.5 percents (0.19 < 0.21):
s64da_tpcds.query96
Average pg-src-17--.* better than pg-src-16--.* by 9.5 percents (0.19 < 0.21):
s64da_tpcds.query96
Best pg-src-17--.* worse than pg-src-16--.* by 50.0 percents (0.24 > 0.16):
s64da_tpcds.query98
Average pg-src-17--.* worse than pg-src-16--.* by 26.3 percents (0.24 > 0.19):
s64da_tpcds.query98
Best pg-src-17--.* worse than pg-src-16--.* by 37.8 percents (0.51 > 0.37):
s64da_tpcds.query99
Average pg-src-17--.* worse than pg-src-16--.* by 53.1 percents (0.58 > 0.38):
s64da_tpcds.query99
Best pg-src-17--.* better than pg-src-16--.* by 6.1 percents (30.63 < 32.62):
s64da_ssb.total
Average pg-src-17--.* better than pg-src-16--.* by 6.4 percents (30.78 <
32.87): s64da_ssb.total
Best pg-src-17--.* better than pg-src-16--.* by 5.9 percents (2.40 < 2.55):
s64da_ssb.queryQ1.1
Average pg-src-17--.* better than pg-src-16--.* by 5.6 percents (2.41 < 2.55):
s64da_ssb.queryQ1.1
Best pg-src-17--.* better than pg-src-16--.* by 6.1 percents (2.31 < 2.46):
s64da_ssb.queryQ1.2
Average pg-src-17--.* better than pg-src-16--.* by 6.7 percents (2.32 < 2.48):
s64da_ssb.queryQ1.2
Best pg-src-17--.* better than pg-src-16--.* by 6.5 percents (2.29 < 2.45):
s64da_ssb.queryQ1.3
Average pg-src-17--.* better than pg-src-16--.* by 6.5 percents (2.30 < 2.46):
s64da_ssb.queryQ1.3
Best pg-src-17--.* better than pg-src-16--.* by 16.9 percents (2.31 < 2.78):
s64da_ssb.queryQ2.1
Average pg-src-17--.* better than pg-src-16--.* by 10.4 percents (2.51 < 2.80):
s64da_ssb.queryQ2.1
Best pg-src-17--.* better than pg-src-16--.* by 7.1 percents (2.21 < 2.38):
s64da_ssb.queryQ2.2
Average pg-src-17--.* better than pg-src-16--.* by 7.2 percents (2.23 < 2.40):
s64da_ssb.queryQ2.2
Best pg-src-17--.* better than pg-src-16--.* by 8.5 percents (1.94 < 2.12):
s64da_ssb.queryQ2.3
Average pg-src-17--.* better than pg-src-16--.* by 8.9 percents (1.94 < 2.13):
s64da_ssb.queryQ2.3
Best pg-src-17--.* better than pg-src-16--.* by 5.4 percents (2.95 < 3.12):
s64da_ssb.queryQ3.1
Average pg-src-17--.* better than pg-src-16--.* by 7.3 percents (3.08 < 3.33):
s64da_ssb.queryQ3.1
Best pg-src-17--.* better than pg-src-16--.* by 7.2 percents (1.94 < 2.09):
s64da_ssb.queryQ3.2
Best pg-src-17--.* better than pg-src-16--.* by 6.5 percents (1.74 < 1.86):
s64da_ssb.queryQ3.3
Average pg-src-17--.* better than pg-src-16--.* by 6.3 percents (1.74 < 1.86):
s64da_ssb.queryQ3.3
Best pg-src-17--.* better than pg-src-16--.* by 8.1 percents (1.71 < 1.86):
s64da_ssb.queryQ3.4
Average pg-src-17--.* better than pg-src-16--.* by 7.0 percents (1.73 < 1.86):
s64da_ssb.queryQ3.4
Average pg-src-17--.* better than pg-src-16--.* by 5.7 percents (2.43 < 2.58):
s64da_ssb.queryQ4.3
Best pg-src-17--.* better than pg-src-16--.* by 7.2 percents (3.10 < 3.34):
job.query10c
Average pg-src-17--.* better than pg-src-16--.* by 7.5 percents (3.12 < 3.37):
job.query10c
Average pg-src-17--.* better than pg-src-16--.* by 35.7 percents (0.09 < 0.14):
job.query11b
Average pg-src-17--.* worse than pg-src-16--.* by 9.0 percents (1.22 > 1.12):
job.query11c
Average pg-src-17--.* better than pg-src-16--.* by 5.3 percents (0.06 < 0.06):
job.query12b
Best pg-src-17--.* worse than pg-src-16--.* by 6.5 percents (0.66 > 0.62):
job.query13c
Average pg-src-17--.* worse than pg-src-16--.* by 6.4 percents (0.67 > 0.63):
job.query13c
Best pg-src-17--.* worse than pg-src-16--.* by 5.1 percents (2.06 > 1.96):
job.query13d
Best pg-src-17--.* worse than pg-src-16--.* by 6.5 percents (0.99 > 0.93):
job.query14c
Average pg-src-17--.* worse than pg-src-16--.* by 5.6 percents (1.01 > 0.96):
job.query14c
Best pg-src-17--.* better than pg-src-16--.* by 6.1 percents (0.31 < 0.33):
job.query15a
Best pg-src-17--.* better than pg-src-16--.* by 16.3 percents (0.72 < 0.86):
job.query15c
Average pg-src-17--.* better than pg-src-16--.* by 41.9 percents (0.72 < 1.24):
job.query15c
Best pg-src-17--.* better than pg-src-16--.* by 6.3 percents (0.89 < 0.95):
job.query15d
Average pg-src-17--.* better than pg-src-16--.* by 6.3 percents (0.89 < 0.95):
job.query15d
Best pg-src-17--.* better than pg-src-16--.* by 89.3 percents (0.50 < 4.67):
job.query18a
Average pg-src-17--.* better than pg-src-16--.* by 28.9 percents (3.37 < 4.75):
job.query18a
Average pg-src-17--.* worse than pg-src-16--.* by 5.4 percents (1.43 > 1.35):
job.query18b
Best pg-src-17--.* better than pg-src-16--.* by 93.2 percents (0.27 < 3.96):
job.query19a
Average pg-src-17--.* better than pg-src-16--.* by 63.5 percents (1.46 < 3.99):
job.query19a
Best pg-src-17--.* better than pg-src-16--.* by 15.0 percents (0.17 < 0.20):
job.query19b
Average pg-src-17--.* better than pg-src-16--.* by 10.0 percents (0.18 < 0.20):
job.query19b
Average pg-src-17--.* better than pg-src-16--.* by 10.0 percents (0.06 < 0.07):
job.query1a
Best pg-src-17--.* better than pg-src-16--.* by 16.7 percents (0.05 < 0.06):
job.query1b
Average pg-src-17--.* better than pg-src-16--.* by 16.7 percents (0.05 < 0.06):
job.query1b
Best pg-src-17--.* better than pg-src-16--.* by 16.7 percents (0.05 < 0.06):
job.query1d
Average pg-src-17--.* better than pg-src-16--.* by 11.1 percents (0.05 < 0.06):
job.query1d
Best pg-src-17--.* worse than pg-src-16--.* by 7.8 percents (0.69 > 0.64):
job.query20c
Average pg-src-17--.* worse than pg-src-16--.* by 17.4 percents (0.76 > 0.65):
job.query20c
Average pg-src-17--.* better than pg-src-16--.* by 24.0 percents (0.51 < 0.67):
job.query23c
Best pg-src-17--.* worse than pg-src-16--.* by 38.6 percents (1.76 > 1.27):
job.query24a
Average pg-src-17--.* worse than pg-src-16--.* by 10.0 percents (1.77 > 1.61):
job.query24a
Best pg-src-17--.* better than pg-src-16--.* by 50.0 percents (0.38 < 0.76):
job.query26a
Average pg-src-17--.* better than pg-src-16--.* by 28.6 percents (0.55 < 0.77):
job.query26a
Best pg-src-17--.* worse than pg-src-16--.* by 31.2 percents (0.21 > 0.16):
job.query26b
Best pg-src-17--.* better than pg-src-16--.* by 34.0 percents (1.24 < 1.88):
job.query26c
Average pg-src-17--.* better than pg-src-16--.* by 6.5 percents (1.88 < 2.01):
job.query26c
Best pg-src-17--.* better than pg-src-16--.* by 33.3 percents (0.14 < 0.21):
job.query27b
Average pg-src-17--.* better than pg-src-16--.* by 12.3 percents (0.19 < 0.22):
job.query27b
Best pg-src-17--.* worse than pg-src-16--.* by 73.8 percents (0.73 > 0.42):
job.query27c
Average pg-src-17--.* worse than pg-src-16--.* by 35.6 percents (0.74 > 0.54):
job.query27c
Best pg-src-17--.* worse than pg-src-16--.* by 14.5 percents (0.95 > 0.83):
job.query28a
Average pg-src-17--.* worse than pg-src-16--.* by 21.7 percents (1.14 > 0.94):
job.query28a
Average pg-src-17--.* better than pg-src-16--.* by 11.2 percents (0.58 < 0.66):
job.query28b
Best pg-src-17--.* better than pg-src-16--.* by 81.2 percents (0.42 < 2.23):
job.query28c
Average pg-src-17--.* better than pg-src-16--.* by 70.7 percents (0.68 < 2.31):
job.query28c
Best pg-src-17--.* worse than pg-src-16--.* by 50.0 percents (0.12 > 0.08):
job.query29a
Average pg-src-17--.* worse than pg-src-16--.* by 14.3 percents (0.16 > 0.14):
job.query29a
Average pg-src-17--.* better than pg-src-16--.* by 8.7 percents (0.07 < 0.08):
job.query29b
Average pg-src-17--.* worse than pg-src-16--.* by 37.8 percents (0.68 > 0.49):
job.query29c
Best pg-src-17--.* worse than pg-src-16--.* by 6.3 percents (0.51 > 0.48):
job.query2a
Best pg-src-17--.* better than pg-src-16--.* by 14.8 percents (1.38 < 1.62):
job.query30a
Average pg-src-17--.* worse than pg-src-16--.* by 68.6 percents (5.28 > 3.13):
job.query30a
Best pg-src-17--.* worse than pg-src-16--.* by 9.3 percents (3.64 > 3.33):
job.query30c
Average pg-src-17--.* worse than pg-src-16--.* by 29.5 percents (9.06 > 7.00):
job.query30c
Best pg-src-17--.* better than pg-src-16--.* by 74.8 percents (0.26 < 1.03):
job.query33a
Average pg-src-17--.* worse than pg-src-16--.* by 346.2 percents (6.92 > 1.55):
job.query33a
Best pg-src-17--.* better than pg-src-16--.* by 68.4 percents (0.24 < 0.76):
job.query33b
Average pg-src-17--.* better than pg-src-16--.* by 38.9 percents (1.35 < 2.21):
job.query33b
Best pg-src-17--.* better than pg-src-16--.* by 26.6 percents (1.02 < 1.39):
job.query33c
Average pg-src-17--.* better than pg-src-16--.* by 5.2 percents (2.02 < 2.13):
job.query33c
Best pg-src-17--.* worse than pg-src-16--.* by 5.9 percents (0.18 > 0.17):
job.query3a
Average pg-src-17--.* worse than pg-src-16--.* by 5.9 percents (0.18 > 0.17):
job.query3a
Best pg-src-17--.* worse than pg-src-16--.* by 10.0 percents (0.11 > 0.10):
job.query4c
Average pg-src-17--.* worse than pg-src-16--.* by 10.0 percents (0.11 > 0.10):
job.query4c
Best pg-src-17--.* better than pg-src-16--.* by 5.9 percents (0.16 < 0.17):
job.query5a
Average pg-src-17--.* better than pg-src-16--.* by 5.9 percents (0.16 < 0.17):
job.query5a
Best pg-src-17--.* better than pg-src-16--.* by 6.3 percents (0.15 < 0.16):
job.query5b
Average pg-src-17--.* better than pg-src-16--.* by 10.0 percents (0.15 < 0.17):
job.query5b
Average pg-src-17--.* worse than pg-src-16--.* by 5.6 percents (0.06 > 0.06):
job.query6a
Best pg-src-17--.* worse than pg-src-16--.* by 12.5 percents (1.35 > 1.20):
job.query6b
Average pg-src-17--.* worse than pg-src-16--.* by 9.0 percents (1.38 > 1.26):
job.query6b
Best pg-src-17--.* worse than pg-src-16--.* by 33.3 percents (0.04 > 0.03):
job.query6c
Average pg-src-17--.* worse than pg-src-16--.* by 33.3 percents (0.04 > 0.03):
job.query6c
Best pg-src-17--.* worse than pg-src-16--.* by 11.8 percents (7.08 > 6.33):
job.query6d
Average pg-src-17--.* worse than pg-src-16--.* by 12.6 percents (7.28 > 6.47):
job.query6d
Best pg-src-17--.* worse than pg-src-16--.* by 11.3 percents (7.17 > 6.44):
job.query6f
Average pg-src-17--.* worse than pg-src-16--.* by 12.5 percents (7.39 > 6.57):
job.query6f
Best pg-src-17--.* better than pg-src-16--.* by 7.4 percents (0.25 < 0.27):
job.query7a
Average pg-src-17--.* worse than pg-src-16--.* by 22.2 percents (0.33 > 0.27):
job.query7a
Best pg-src-17--.* better than pg-src-16--.* by 5.0 percents (0.19 < 0.20):
job.query7b
Average pg-src-17--.* better than pg-src-16--.* by 5.0 percents (0.19 < 0.20):
job.query7b
Best pg-src-17--.* better than pg-src-16--.* by 5.0 percents (0.19 < 0.20):
job.query8b
Average pg-src-17--.* better than pg-src-16--.* by 5.0 percents (0.19 < 0.20):
job.query8b
Best pg-src-17--.* better than pg-src-16--.* by 90.0 percents (0.26 < 2.59):
job.query9a
Average pg-src-17--.* better than pg-src-16--.* by 61.0 percents (1.02 < 2.61):
job.query9a
Best pg-src-17--.* better than pg-src-16--.* by 10.7 percents (0.25 < 0.28):
job.query9b
Average pg-src-17--.* better than pg-src-16--.* by 76.9 percents (0.26 < 1.11):
job.query9b
Best pg-src-17--.* better than pg-src-16--.* by 5.1 percents (2446620.01 >
2327793.41): sysbench.load_bulk_insert_tps
Average pg-src-17--.* better than pg-src-16--.* by 5.5 percents (2429492.51 >
2302709.87): sysbench.load_bulk_insert_tps
Average pg-src-17--.* worse than pg-src-16--.* by 6.5 percents (26170.06 <
28000.48): sysbench.load_oltp_write_only_tps
Best pg-src-17--.* better than pg-src-16--.* by 19.8 percents (262444.51 >
219017.92): sysbench.load_select_random_points_tps
Average pg-src-17--.* better than pg-src-16--.* by 20.2 percents (260920.15 >
217097.70): sysbench.load_select_random_points_tps
Best pg-src-17--.* better than pg-src-16--.* by 5.5 percents (86.44 > 81.91):
sysbench.load_bulk_insert_ops
Average pg-src-17--.* better than pg-src-16--.* by 6.0 percents (85.79 >
80.95): sysbench.load_bulk_insert_ops
Average pg-src-17--.* worse than pg-src-16--.* by 6.5 percents (157291.74 <
168295.39): sysbench.load_oltp_write_only_ops
Best pg-src-17--.* better than pg-src-16--.* by 19.8 percents (262444.51 >
219017.92): sysbench.load_select_random_points_ops
Average pg-src-17--.* better than pg-src-16--.* by 20.2 percents (260920.15 >
217097.70): sysbench.load_select_random_points_ops
Average pg-src-17--.* better than pg-src-16--.* by 6.1 percents (34.43 <
36.67): insert-1m.time
Title: Postgres benchmarking results
Benchmarking run started at 2024-07-29T13:12:55, ended at 2024-07-30T06:38:51
Benchmark version| Instance | version |
|---|
| pg-src-16--1 | PostgreSQL 16.3-REL_16_STABLE/6f6b0f193d on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
| pg-src-17--1 | PostgreSQL 17beta2-REL_17_STABLE/1e020258e5 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
| pg-src-16--2 | PostgreSQL 16.3-REL_16_STABLE/6f6b0f193d on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
| pg-src-17--2 | PostgreSQL 17beta2-REL_17_STABLE/1e020258e5 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
| pg-src-17--3 | PostgreSQL 17beta2-REL_17_STABLE/1e020258e5 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
| pg-src-16--3 | PostgreSQL 16.3-REL_16_STABLE/6f6b0f193d on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
Benchmark pgbench_native| Instance | tps |
|---|
| pg-src-16--1 | 10536.51 |
| pg-src-17--1 | 10660.13 |
| pg-src-16--2 | 10481.51 |
| pg-src-17--2 | 10594.45 |
| pg-src-17--3 | 10693.34 |
| pg-src-16--3 | 10553.12 |
Benchmark pgbench_reference| Instance | latency_avg | tps1 | tps2 |
|---|
| pg-src-16--1 | 8.59 | 7450.58 | 7450.62 |
| pg-src-17--1 | 8.29 | 7723.94 | 7723.98 |
| pg-src-16--2 | 8.46 | 7568.24 | 7568.27 |
| pg-src-17--2 | 8.34 | 7676.04 | 7676.07 |
| pg-src-17--3 | 8.31 | 7700.71 | 7700.75 |
| pg-src-16--3 | 8.47 | 7552.34 | 7552.37 |
Benchmark pg_tpch| Instance | query1 | query2 | query3 | query4 | query5 | query6 | query7 | query8 | query9 | query10 | query11 | query12 | query13 | query14 | query15 | query16 | query17 | query18 | query19 | query20 | query21 | query22 |
|---|
| pg-src-16--1 | 9.62 | 1.46 | 3.00 | 0.68 | 0.89 | 1.47 | 2.91 | 4.54 | 0.95 | 2.45 | 0.77 | 2.20 | 2.81 | 0.86 | 3.22 | 1.01 | 8.62 | 14.39 | 0.19 | 5.91 | 2.35 | 0.23 |
| pg-src-17--1 | 9.06 | 1.44 | 2.84 | 0.69 | 0.89 | 1.37 | 2.79 | 4.46 | 0.90 | 2.38 | 0.78 | 2.12 | 2.64 | 0.85 | 3.02 | 1.00 | 8.18 | 14.01 | 0.19 | 4.81 | 2.30 | 0.23 |
| pg-src-16--2 | 9.66 | 1.46 | 3.04 | 0.70 | 0.92 | 1.47 | 2.94 | 4.47 | 0.87 | 2.49 | 0.78 | 2.23 | 2.81 | 0.87 | 3.24 | 1.00 | 8.63 | 14.27 | 0.19 | 5.93 | 2.38 | 0.23 |
| pg-src-17--2 | 9.05 | 1.46 | 2.85 | 0.69 | 0.86 | 1.35 | 2.77 | 4.35 | 0.90 | 2.37 | 0.76 | 2.10 | 2.76 | 0.86 | 3.04 | 0.98 | 8.21 | 13.91 | 0.19 | 5.53 | 2.28 | 0.22 |
| pg-src-17--3 | 9.04 | 1.44 | 2.86 | 0.69 | 0.88 | 1.36 | 2.80 | 4.44 | 0.91 | 2.37 | 0.76 | 2.13 | 2.58 | 0.86 | 3.04 | 0.99 | 8.14 | 13.98 | 0.18 | 5.56 | 2.29 | 0.22 |
| pg-src-16--3 | 9.55 | 1.46 | 3.03 | 0.69 | 0.90 | 1.47 | 2.92 | 4.57 | 0.85 | 2.48 | 0.76 | 2.22 | 2.86 | 0.88 | 3.23 | 0.99 | 8.63 | 14.47 | 0.19 | 5.94 | 2.37 | 0.23 |
Benchmark pg_tpcds| Instance | load_size | indexes_size | vacuum_full_size | vacuum_freeze_size | load_time | indexes_time | vacuum_full_time | vacuum_freeze_time | analyze_time | query92 | query91 | query13 | query9 | query21 | query90 | query93 | query16 | query68 | query48 | query76 | query7 | query37 | query43 | query72 | query82 | query79 | query55 | query66 | query71 | query69 | query34 | query45 | query10 | query28 | query3 | query15 | query50 | query85 | query84 | query42 | query73 | query94 | query46 | query88 | query19 | query40 | query26 | query96 | query6 | query52 |
|---|
| pg-src-16--1 | 5069432.00 | 7250132.00 | 6939884.00 | 6942556.00 | 77.75 | 72.60 | 94.56 | 2.20 | 3.42 | 78.77 | 42.93 | 644.40 | 1429.52 | 159.04 | 144.44 | 4.68 | 94.31 | 268.20 | 780.57 | 381.67 | 1184.76 | 7.83 | 714.93 | 19669.34 | 9.83 | 343.15 | 278.35 | 297.75 | 238.64 | 110.27 | 244.09 | 129.62 | 31.64 | 661.52 | 29.47 | 142.52 | 57.43 | 114.68 | 15.71 | 281.67 | 203.49 | 73.68 | 501.04 | 1667.03 | 311.28 | 74.79 | 570.61 | 202.79 | 22691.44 | 289.46 |
| pg-src-17--1 | 5069680.00 | 7250104.00 | 6939812.00 | 6942488.00 | 78.40 | 70.98 | 91.09 | 2.07 | 3.44 | 75.20 | 43.55 | 605.76 | 1324.73 | 192.25 | 138.75 | 4.99 | 145.53 | 255.18 | 740.79 | 372.10 | 1191.53 | 7.38 | 685.25 | 24269.21 | 9.12 | 325.70 | 274.86 | 434.72 | 223.85 | 112.00 | 228.09 | 128.27 | 31.31 | 645.42 | 28.98 | 225.11 | 55.82 | 113.30 | 14.39 | 273.29 | 181.83 | 70.01 | 478.45 | 1525.30 | 296.51 | 93.39 | 987.16 | 185.61 | 16957.49 | 277.99 |
| pg-src-16--2 | 5069448.00 | 7250136.00 | 6939884.00 | 6942556.00 | 76.89 | 72.60 | 94.50 | 2.21 | 3.42 | 80.28 | 43.61 | 644.42 | 1433.55 | 155.58 | 144.77 | 4.89 | 98.36 | 268.23 | 778.46 | 381.05 | 1188.18 | 7.98 | 712.84 | 19539.89 | 10.28 | 344.44 | 283.47 | 299.61 | 242.72 | 113.93 | 246.34 | 133.16 | 31.28 | 671.56 | 28.94 | 150.13 | 57.82 | 176.06 | 15.00 | 315.71 | 205.28 | 74.29 | 495.64 | 1656.23 | 307.21 | 74.08 | 562.39 | 202.46 | 22620.88 | 290.00 |
| pg-src-17--2 | 5069696.00 | 7250100.00 | 6939808.00 | 6942480.00 | 78.37 | 70.82 | 90.76 | 2.10 | 3.45 | 73.84 | 45.17 | 607.12 | 1329.71 | 198.92 | 139.66 | 4.35 | 146.90 | 256.66 | 746.00 | 375.47 | 1195.40 | 13.73 | 695.33 | 24530.51 | 9.02 | 324.39 | 313.40 | 403.55 | 220.67 | 112.91 | 227.54 | 129.44 | 31.03 | 658.25 | 29.09 | 227.15 | 56.90 | 114.09 | 14.80 | 330.89 | 188.77 | 68.85 | 480.76 | 1521.84 | 298.54 | 100.13 | 983.71 | 182.63 | 16891.29 | 296.43 |
| pg-src-17--3 | 5069676.00 | 7250108.00 | 6939808.00 | 6942480.00 | 78.34 | 70.86 | 91.13 | 2.07 | 3.45 | 73.32 | 44.27 | 600.38 | 1327.04 | 197.39 | 139.11 | 5.23 | 148.11 | 250.23 | 740.92 | 373.97 | 1191.83 | 7.38 | 682.44 | 24753.25 | 9.07 | 323.83 | 270.96 | 427.89 | 225.96 | 113.02 | 227.44 | 128.59 | 30.93 | 643.15 | 29.20 | 239.46 | 55.23 | 113.10 | 14.56 | 269.02 | 180.90 | 69.01 | 480.52 | 1512.23 | 297.76 | 94.08 | 942.11 | 181.90 | 16906.16 | 268.10 |
| pg-src-16--3 | 5069424.00 | 7250132.00 | 6939884.00 | 6942556.00 | 77.33 | 72.52 | 93.86 | 2.22 | 3.44 | 80.66 | 48.37 | 640.59 | 1431.27 | 155.92 | 143.09 | 4.71 | 100.94 | 265.52 | 777.77 | 376.50 | 1195.67 | 8.05 | 719.67 | 20011.13 | 10.31 | 344.36 | 285.33 | 299.88 | 239.42 | 113.18 | 245.90 | 131.26 | 31.76 | 663.66 | 29.34 | 152.23 | 57.00 | 114.30 | 15.35 | 280.46 | 199.68 | 74.51 | 495.07 | 1667.67 | 310.61 | 74.61 | 577.31 | 201.92 | 22604.77 | 280.96 |
Benchmark ycsb| Instance | load_a_size | load_b_size | load_c_size | load_d_size | load_f_size | load_a_time | load_b_time | load_c_time | load_d_time | load_f_time | load_a_10_runtime | load_a_25_runtime | load_a_50_runtime | load_b_10_runtime | load_b_25_runtime | load_b_50_runtime | load_c_10_runtime | load_c_25_runtime | load_c_50_runtime | load_d_10_runtime | load_d_25_runtime | load_d_50_runtime | load_f_10_runtime | load_f_25_runtime | load_f_50_runtime | load_a_10_ops | load_a_25_ops | load_a_50_ops | load_b_10_ops | load_b_25_ops | load_b_50_ops | load_c_10_ops | load_c_25_ops | load_c_50_ops | load_d_10_ops | load_d_25_ops | load_d_50_ops | load_f_10_ops | load_f_25_ops | load_f_50_ops |
|---|
| pg-src-16--1 | 2259520.00 | 2277604.00 | 2277248.00 | 2277168.00 | 2279256.00 | 42.71 | 40.81 | 41.42 | 40.87 | 43.10 | 6957.00 | 5181.00 | 5241.00 | 5215.00 | 3701.00 | 3342.00 | 4598.00 | 2931.00 | 2923.00 | 4460.00 | 3197.00 | 3039.00 | 9130.00 | 6794.00 | 6647.00 | 143740.12 | 193012.93 | 190803.28 | 191754.55 | 270197.24 | 299222.02 | 217485.86 | 341180.48 | 342114.27 | 224215.25 | 312793.24 | 329055.61 | 109529.03 | 147188.70 | 150443.81 |
| pg-src-17--1 | 2259492.00 | 2277304.00 | 2277084.00 | 2277140.00 | 2278584.00 | 40.97 | 40.05 | 40.60 | 40.29 | 40.08 | 7342.00 | 5451.00 | 5678.00 | 4847.00 | 3933.00 | 3434.00 | 4620.00 | 2926.00 | 3005.00 | 4509.00 | 3099.00 | 3037.00 | 9206.00 | 8367.00 | 7250.00 | 136202.67 | 183452.58 | 176118.35 | 206313.18 | 254258.84 | 291205.59 | 216450.22 | 341763.50 | 332778.70 | 221778.66 | 322684.74 | 329272.31 | 108624.81 | 119517.15 | 137931.03 |
| pg-src-16--2 | 2259520.00 | 2277336.00 | 2276716.00 | 2277156.00 | 2279252.00 | 41.40 | 41.00 | 42.30 | 41.14 | 41.03 | 6873.00 | 5172.00 | 5218.00 | 4987.00 | 3922.00 | 3247.00 | 4648.00 | 2969.00 | 2985.00 | 4532.00 | 3161.00 | 3088.00 | 8948.00 | 6583.00 | 6866.00 | 145496.87 | 193348.80 | 191644.31 | 200521.36 | 254971.95 | 307976.59 | 215146.30 | 336813.74 | 335008.38 | 220653.13 | 316355.58 | 323834.20 | 111756.82 | 151906.43 | 145645.21 |
| pg-src-17--2 | 2259488.00 | 2277320.00 | 2277100.00 | 2277148.00 | 2278336.00 | 40.01 | 40.22 | 39.72 | 40.39 | 39.51 | 8011.00 | 5420.00 | 5765.00 | 4851.00 | 3946.00 | 3313.00 | 4625.00 | 2985.00 | 3007.00 | 4455.00 | 3048.00 | 3075.00 | 8952.00 | 9119.00 | 6912.00 | 124828.36 | 184501.85 | 173460.54 | 206143.06 | 253421.19 | 301841.23 | 216216.22 | 335008.38 | 332557.37 | 224466.89 | 328083.99 | 325203.25 | 111706.88 | 109661.15 | 144675.93 |
| pg-src-17--3 | 2259488.00 | 2277564.00 | 2277224.00 | 2277136.00 | 2278852.00 | 43.33 | 39.86 | 39.65 | 41.67 | 41.89 | 7180.00 | 5466.00 | 5817.00 | 5679.00 | 3436.00 | 3326.00 | 4542.00 | 3028.00 | 2894.00 | 4395.00 | 3216.00 | 3148.00 | 10750.00 | 8740.00 | 7029.00 | 139275.77 | 182949.14 | 171909.92 | 176087.34 | 291036.09 | 300661.46 | 220167.33 | 330250.99 | 345542.50 | 227531.29 | 310945.27 | 317662.01 | 93023.26 | 114416.48 | 142267.75 |
| pg-src-16--3 | 2259516.00 | 2277600.00 | 2277260.00 | 2277164.00 | 2278876.00 | 43.18 | 40.45 | 40.37 | 40.54 | 40.74 | 7142.00 | 5144.00 | 5391.00 | 5269.00 | 3400.00 | 3319.00 | 4471.00 | 3024.00 | 2942.00 | 4398.00 | 3069.00 | 2983.00 | 11093.00 | 6668.00 | 7172.00 | 140016.80 | 194401.24 | 185494.34 | 189789.33 | 294117.65 | 301295.57 | 223663.61 | 330687.83 | 339904.83 | 227376.08 | 325839.04 | 335232.99 | 90146.94 | 149970.01 | 139431.12 |
Benchmark benchmarksql_tpcc| Instance | tpm_total | xacts | data_size |
|---|
| pg-src-16--1 | 207779.00 | 623364.00 | 2780220.00 |
| pg-src-17--1 | 221078.00 | 663290.00 | 2789132.00 |
| pg-src-16--2 | 205220.00 | 615668.00 | 2784372.00 |
| pg-src-17--2 | 215190.00 | 645588.00 | 2766848.00 |
| pg-src-17--3 | 209403.00 | 628222.00 | 2746100.00 |
| pg-src-16--3 | 204791.00 | 614393.00 | 2774228.00 |
Benchmark benchbase| Instance | auctionmark_rps | epinions_rps | hyadapt_rps | otmetrics_rps | resourcestresser_rps | seats_rps | sibench_rps | smallbank_rps | tatp_rps | tpcc_rps | tpch_rps | twitter_rps | voter_rps | ycsb_rps |
|---|
| pg-src-16--1 | 143.24 | 79120.36 | 14261.29 | 7217.73 | 1.14 | 9895.44 | 48945.04 | 36874.52 | 98426.00 | 7221.29 | 0.28 | 72820.28 | 45764.64 | 130881.26 |
| pg-src-17--1 | 158.49 | 88936.33 | 13864.16 | 7296.99 | 0.98 | 10126.57 | 50673.78 | 35842.48 | 99637.38 | 7045.50 | 0.29 | 73249.90 | 45375.98 | 127977.64 |
| pg-src-16--2 | 160.75 | 79926.11 | 14151.73 | 7299.91 | 1.14 | 10529.52 | 48378.90 | 38390.82 | 97906.37 | 6999.91 | 0.30 | 73095.77 | 45408.17 | 122285.97 |
| pg-src-17--2 | 148.50 | 87418.59 | 14822.20 | 7867.24 | 1.21 | 10554.92 | 51916.29 | 35860.02 | 98248.28 | 6428.54 | 0.29 | 75172.44 | 44539.07 | 127709.62 |
| pg-src-17--3 | 161.28 | 87809.95 | 13908.17 | 7756.03 | 0.93 | 10143.84 | 48170.90 | 36142.02 | 101253.71 | 6478.26 | 0.29 | 73921.45 | 44989.33 | 129261.41 |
| pg-src-16--3 | 162.74 | 80739.14 | 14730.26 | 7417.44 | 1.22 | 10072.70 | 48628.86 | 36821.58 | 100970.38 | 7314.67 | 0.30 | 74283.01 | 45695.20 | 128327.21 |
Benchmark gdprbench| Instance | load_controller_ops | run_controller_ops | load_customer_ops | run_customer_ops | load_processor_ops | run_processor_ops |
|---|
| pg-src-16--1 | 17123.29 | 1715.27 | 19455.25 | 2057.61 | 17241.38 | 1351.35 |
| pg-src-17--1 | 17574.69 | 1776.20 | 17361.11 | 2066.12 | 16638.94 | 1310.62 |
| pg-src-16--2 | 15479.88 | 1795.33 | 17452.01 | 1992.03 | 14858.84 | 1321.00 |
| pg-src-17--2 | 16949.15 | 1792.11 | 17182.13 | 2000.00 | 19455.25 | 1367.99 |
| pg-src-17--3 | 18518.52 | 1742.16 | 17605.63 | 2004.01 | 16474.46 | 1293.66 |
| pg-src-16--3 | 16722.41 | 1838.24 | 18382.35 | 2040.82 | 16920.47 | 1298.70 |
Benchmark s64da_tpch| Instance | total | query1 | query2 | query3 | query4 | query5 | query6 | query7 | query8 | query9 | query10 | query11 | query12 | query13 | query14 | query15 | query16 | query17 | query18 | query19 | query20 | query21 | query22 |
|---|
| pg-src-16--1 | 68.46 | 9.16 | 1.38 | 2.93 | 0.89 | 1.67 | 1.38 | 1.92 | 1.04 | 4.72 | 2.27 | 0.72 | 2.49 | 2.84 | 0.88 | 1.55 | 1.02 | 4.34 | 20.99 | 0.19 | 1.03 | 4.84 | 0.21 |
| pg-src-17--1 | 66.15 | 8.71 | 1.40 | 2.84 | 0.88 | 1.53 | 1.27 | 1.80 | 1.07 | 4.60 | 2.16 | 0.71 | 2.38 | 2.80 | 0.88 | 1.44 | 1.01 | 4.14 | 20.42 | 0.18 | 1.05 | 4.69 | 0.20 |
| pg-src-16--2 | 69.11 | 9.20 | 1.36 | 2.93 | 0.90 | 1.69 | 1.37 | 1.93 | 1.10 | 4.67 | 2.28 | 0.70 | 2.47 | 2.90 | 0.88 | 1.56 | 1.01 | 4.32 | 21.57 | 0.18 | 1.06 | 4.82 | 0.21 |
| pg-src-17--2 | 65.34 | 8.69 | 1.38 | 2.81 | 0.88 | 1.52 | 1.26 | 1.80 | 1.06 | 3.88 | 2.16 | 0.73 | 2.40 | 2.79 | 0.86 | 1.41 | 0.96 | 4.19 | 20.39 | 0.19 | 1.07 | 4.70 | 0.20 |
| pg-src-17--3 | 65.85 | 8.63 | 1.35 | 2.75 | 0.90 | 1.56 | 1.26 | 1.79 | 1.09 | 4.66 | 2.15 | 0.67 | 2.37 | 2.76 | 0.86 | 1.42 | 1.01 | 4.17 | 20.36 | 0.18 | 1.07 | 4.61 | 0.20 |
| pg-src-16--3 | 68.31 | 9.11 | 1.35 | 2.93 | 0.89 | 1.69 | 1.37 | 1.93 | 1.13 | 3.96 | 2.28 | 0.70 | 2.49 | 2.89 | 0.87 | 1.54 | 1.03 | 4.24 | 21.60 | 0.18 | 1.03 | 4.89 | 0.21 |
Benchmark s64da_tpcds| Instance | total | query1 | query2 | query3 | query5 | query6 | query7 | query8 | query9 | query12 | query13 | query14a | query14b | query15 | query16 | query17 | query18 | query19 | query20 | query21 | query22 | query23a | query23b | query24a | query24b | query25 | query26 | query27 | query28 | query29 | query30 | query31 | query32 | query33 | query34 | query35 | query36 | query37 | query38 | query39a | query39b | query40 | query41 | query42 | query43 | query44 | query45 | query46 | query47 | query48 | query49 | query50 | query51 | query52 | query53 | query54 | query55 | query56 | query57 | query58 | query59 | query60 | query61 | query62 | query63 | query64 | query65 | query66 | query67 | query68 | query69 | query70 | query71 | query72 | query73 | query75 | query76 | query78 | query79 | query80 | query81 | query82 | query83 | query84 | query85 | query86 | query87 | query88 | query89 | query90 | query91 | query92 | query93 | query94 | query95 | query96 | query97 | query98 | query99 |
|---|
| pg-src-16--1 | 2708.54 | 0.00 | 1.01 | 0.01 | 0.58 | 209.84 | 1.12 | 0.06 | 2.55 | 0.05 | 0.65 | 30.74 | 68.12 | 0.14 | 0.09 | 0.89 | 0.69 | 0.23 | 0.07 | 0.12 | 4.71 | 6.97 | 6.92 | 0.01 | 0.01 | 0.63 | 0.56 | 0.96 | 1.96 | 0.40 | 55.71 | 17.07 | 0.05 | 0.33 | 0.25 | 2.28 | 0.82 | 0.01 | 2.18 | 4.25 | 4.29 | 0.08 | 1.19 | 0.31 | 0.01 | 0.00 | 1.26 | 0.50 | 2.17 | 0.77 | 0.16 | 0.08 | 2.60 | 0.30 | 0.50 | 0.11 | 0.22 | 1.05 | 1.09 | 0.12 | 1.60 | 2.23 | 0.01 | 0.22 | 0.49 | 0.59 | 1.46 | 0.29 | 1.92 | 0.23 | 0.14 | 1.13 | 0.15 | 20.80 | 0.21 | 2.05 | 0.37 | 2.78 | 0.39 | 0.38 | 249.35 | 0.01 | 0.10 | 0.02 | 0.17 | 0.27 | 2.21 | 1.69 | 0.36 | 0.15 | 0.04 | 0.07 | 0.09 | 0.08 | 174.74 | 0.21 | 1.08 | 0.25 | 0.37 |
| pg-src-17--1 | 3816.70 | 934.83 | 0.94 | 0.01 | 0.56 | 205.72 | 1.13 | 0.05 | 2.38 | 0.05 | 0.61 | 31.00 | 66.81 | 0.23 | 0.12 | 0.91 | 1.00 | 0.30 | 0.07 | 0.20 | 4.46 | 6.81 | 6.85 | 0.01 | 0.01 | 0.64 | 0.85 | 0.99 | 1.85 | 0.41 | 54.95 | 16.95 | 0.05 | 0.23 | 0.23 | 2.29 | 0.81 | 0.01 | 2.22 | 3.88 | 3.91 | 0.12 | 1.14 | 0.28 | 0.01 | 0.00 | 1.27 | 0.48 | 2.30 | 0.74 | 0.16 | 0.06 | 2.40 | 0.28 | 0.50 | 0.11 | 0.28 | 1.10 | 1.41 | 0.12 | 1.36 | 2.33 | 0.01 | 0.21 | 0.50 | 0.56 | 1.36 | 0.40 | 1.85 | 0.21 | 0.14 | 1.08 | 0.24 | 25.64 | 0.19 | 1.85 | 0.39 | 3.29 | 0.37 | 0.39 | 240.74 | 0.01 | 0.10 | 0.03 | 0.17 | 0.27 | 2.27 | 1.54 | 0.33 | 0.14 | 0.05 | 0.06 | 0.09 | 0.08 | 358.20 | 0.19 | 1.05 | 0.24 | 0.71 |
| pg-src-16--2 | 2708.09 | 0.00 | 0.98 | 0.01 | 0.58 | 210.22 | 1.14 | 0.06 | 2.53 | 0.05 | 0.65 | 31.01 | 68.25 | 0.14 | 0.09 | 0.90 | 0.71 | 0.31 | 0.07 | 0.12 | 4.69 | 7.01 | 6.89 | 0.01 | 0.01 | 0.64 | 0.59 | 0.99 | 1.99 | 0.41 | 55.71 | 17.02 | 0.05 | 0.21 | 0.25 | 2.31 | 0.83 | 0.01 | 2.17 | 4.26 | 4.24 | 0.08 | 1.20 | 0.29 | 0.01 | 0.00 | 1.28 | 0.50 | 2.18 | 0.77 | 0.16 | 0.06 | 2.61 | 0.29 | 0.48 | 0.11 | 0.29 | 1.04 | 1.09 | 0.12 | 1.57 | 2.20 | 0.01 | 0.22 | 0.48 | 0.58 | 1.47 | 0.30 | 1.91 | 0.23 | 0.14 | 1.13 | 0.25 | 20.52 | 0.21 | 2.03 | 0.38 | 2.82 | 0.39 | 0.53 | 249.03 | 0.01 | 0.10 | 0.03 | 0.17 | 0.27 | 2.21 | 1.70 | 0.36 | 0.15 | 0.05 | 0.07 | 0.09 | 0.08 | 173.96 | 0.21 | 1.07 | 0.16 | 0.38 |
| pg-src-17--2 | 3820.14 | 937.81 | 0.94 | 0.01 | 0.56 | 206.02 | 1.14 | 0.07 | 2.37 | 0.05 | 0.61 | 30.81 | 67.06 | 0.23 | 0.12 | 0.90 | 1.01 | 0.24 | 0.07 | 0.20 | 4.46 | 7.01 | 6.81 | 0.01 | 0.01 | 0.65 | 0.83 | 0.98 | 1.83 | 0.42 | 54.02 | 16.84 | 0.06 | 0.25 | 0.23 | 2.31 | 0.81 | 0.01 | 2.23 | 3.85 | 3.89 | 0.12 | 1.14 | 0.33 | 0.01 | 0.00 | 1.27 | 0.49 | 2.29 | 0.76 | 0.16 | 0.06 | 2.43 | 0.32 | 0.49 | 0.11 | 0.22 | 1.06 | 1.41 | 0.12 | 1.35 | 2.28 | 0.01 | 0.21 | 0.51 | 0.58 | 1.36 | 0.39 | 1.84 | 0.21 | 0.14 | 1.07 | 0.15 | 25.05 | 0.19 | 1.86 | 0.38 | 3.23 | 0.37 | 0.55 | 244.13 | 0.01 | 0.11 | 0.03 | 0.17 | 0.26 | 2.25 | 1.57 | 0.34 | 0.14 | 0.05 | 0.06 | 0.09 | 0.08 | 356.63 | 0.19 | 1.06 | 0.24 | 0.51 |
| pg-src-17--3 | 3815.80 | 933.60 | 0.95 | 0.01 | 0.56 | 205.86 | 1.13 | 0.06 | 2.42 | 0.05 | 0.61 | 30.93 | 66.58 | 0.23 | 0.12 | 0.90 | 0.99 | 0.30 | 0.07 | 0.20 | 4.46 | 6.88 | 6.80 | 0.01 | 0.01 | 0.63 | 0.84 | 1.00 | 1.84 | 0.41 | 54.20 | 16.97 | 0.06 | 0.33 | 0.23 | 2.30 | 0.81 | 0.01 | 2.19 | 3.88 | 3.94 | 0.11 | 1.14 | 0.28 | 0.01 | 0.00 | 1.28 | 0.48 | 2.30 | 0.74 | 0.15 | 0.06 | 2.41 | 0.27 | 0.46 | 0.11 | 0.28 | 1.07 | 1.66 | 0.12 | 1.37 | 2.25 | 0.01 | 0.20 | 0.48 | 0.56 | 1.36 | 0.40 | 1.86 | 0.21 | 0.13 | 1.08 | 0.23 | 25.21 | 0.19 | 1.84 | 0.37 | 3.04 | 0.37 | 0.54 | 242.16 | 0.01 | 0.10 | 0.02 | 0.17 | 0.27 | 2.24 | 1.55 | 0.34 | 0.14 | 0.05 | 0.06 | 0.09 | 0.08 | 358.54 | 0.19 | 1.05 | 0.24 | 0.51 |
| pg-src-16--3 | 2706.73 | 0.00 | 0.98 | 0.01 | 0.59 | 208.07 | 1.13 | 0.07 | 2.55 | 0.05 | 0.65 | 30.54 | 67.85 | 0.14 | 0.09 | 0.91 | 0.70 | 0.23 | 0.07 | 0.12 | 4.69 | 6.95 | 6.87 | 0.01 | 0.01 | 0.64 | 0.57 | 0.98 | 1.98 | 0.41 | 55.85 | 17.13 | 0.05 | 0.21 | 0.25 | 2.29 | 0.82 | 0.01 | 2.19 | 4.31 | 4.34 | 0.08 | 1.18 | 0.31 | 0.01 | 0.00 | 0.14 | 0.50 | 2.18 | 0.77 | 0.16 | 0.06 | 2.61 | 0.30 | 0.46 | 0.11 | 0.22 | 1.08 | 1.10 | 0.12 | 1.58 | 2.32 | 0.01 | 0.22 | 0.49 | 0.59 | 1.46 | 0.30 | 1.90 | 0.23 | 0.14 | 1.13 | 0.15 | 21.41 | 0.21 | 2.03 | 0.38 | 2.83 | 0.39 | 0.54 | 250.22 | 0.01 | 0.10 | 0.03 | 0.17 | 0.27 | 2.20 | 1.69 | 0.36 | 0.15 | 0.04 | 0.08 | 0.09 | 0.09 | 174.45 | 0.21 | 1.06 | 0.16 | 0.38 |
Benchmark s64da_ssb| Instance | total | queryQ1.1 | queryQ1.2 | queryQ1.3 | queryQ2.1 | queryQ2.2 | queryQ2.3 | queryQ3.1 | queryQ3.2 | queryQ3.3 | queryQ3.4 | queryQ4.1 | queryQ4.2 | queryQ4.3 |
|---|
| pg-src-16--1 | 32.84 | 2.55 | 2.46 | 2.47 | 2.82 | 2.43 | 2.12 | 3.12 | 2.10 | 1.86 | 1.86 | 3.25 | 3.07 | 2.72 |
| pg-src-17--1 | 30.63 | 2.41 | 2.31 | 2.30 | 2.31 | 2.21 | 1.94 | 2.95 | 2.15 | 1.75 | 1.73 | 3.08 | 2.91 | 2.56 |
| pg-src-16--2 | 32.62 | 2.55 | 2.49 | 2.46 | 2.79 | 2.40 | 2.14 | 3.42 | 2.10 | 1.86 | 1.86 | 3.20 | 3.06 | 2.28 |
| pg-src-17--2 | 30.93 | 2.41 | 2.32 | 2.31 | 2.60 | 2.25 | 1.95 | 2.96 | 2.15 | 1.74 | 1.71 | 3.05 | 2.92 | 2.56 |
| pg-src-17--3 | 30.77 | 2.40 | 2.32 | 2.29 | 2.61 | 2.23 | 1.94 | 3.34 | 1.94 | 1.74 | 1.75 | 3.12 | 2.93 | 2.17 |
| pg-src-16--3 | 33.15 | 2.55 | 2.50 | 2.45 | 2.78 | 2.38 | 2.14 | 3.44 | 2.09 | 1.86 | 1.86 | 3.28 | 3.09 | 2.73 |
Benchmark job| Instance | query10a | query10b | query10c | query11a | query11b | query11c | query11d | query12a | query12b | query12c | query13a | query13b | query13c | query13d | query14a | query14b | query14c | query15a | query15b | query15c | query15d | query16a | query16b | query16c | query16d | query17a | query17b | query17c | query17d | query17e | query17f | query18a | query18b | query18c | query19a | query19b | query19c | query19d | query1a | query1b | query1c | query1d | query20a | query20b | query20c | query21a | query21b | query21c | query22a | query22b | query22c | query22d | query23a | query23b | query23c | query24a | query24b | query25a | query25b | query25c | query26a | query26b | query26c | query27a | query27b | query27c | query28a | query28b | query28c | query29a | query29b | query29c | query2a | query2b | query2c | query2d | query30a | query30b | query30c | query31a | query31b | query31c | query32a | query32b | query33a | query33b | query33c | query3a | query3b | query3c | query4a | query4b | query4c | query5a | query5b | query5c | query6a | query6b | query6c | query6d | query6e | query6f | query7a | query7b | query7c | query8a | query8b | query8c | query8d | query9a | query9b | query9c | query9d |
|---|
| pg-src-16--1 | 0.55 | 0.39 | 3.34 | 0.26 | 0.09 | 1.13 | 4.93 | 0.38 | 0.06 | 1.06 | 1.28 | 0.65 | 0.62 | 1.96 | 0.65 | 0.17 | 0.94 | 0.33 | 0.04 | 0.86 | 0.95 | 0.21 | 17.04 | 1.63 | 1.29 | 9.71 | 7.82 | 7.52 | 7.54 | 11.19 | 9.96 | 4.67 | 1.34 | 6.24 | 3.96 | 0.20 | 6.59 | 7.09 | 0.06 | 0.06 | 0.06 | 0.06 | 2.54 | 1.12 | 0.65 | 0.34 | 0.25 | 0.48 | 0.60 | 0.43 | 2.13 | 1.36 | 0.56 | 0.07 | 0.36 | 1.27 | 0.06 | 3.87 | 0.47 | 11.31 | 0.76 | 0.34 | 1.88 | 0.35 | 0.21 | 0.42 | 0.83 | 0.56 | 2.23 | 0.25 | 0.07 | 0.83 | 0.49 | 0.47 | 0.44 | 0.59 | 1.62 | 0.66 | 5.44 | 3.10 | 0.65 | 3.21 | 0.00 | 1.20 | 1.06 | 1.94 | 1.39 | 0.17 | 0.12 | 0.26 | 0.10 | 0.12 | 0.10 | 0.17 | 0.18 | 0.22 | 0.06 | 1.20 | 0.03 | 6.33 | 0.07 | 6.44 | 0.27 | 0.20 | 11.99 | 2.26 | 0.20 | 4.80 | 3.14 | 2.59 | 1.43 | 2.43 | 4.42 |
| pg-src-17--1 | 0.56 | 0.39 | 3.15 | 0.27 | 0.09 | 1.41 | 4.68 | 0.39 | 0.06 | 1.09 | 1.36 | 0.68 | 0.67 | 2.07 | 0.68 | 0.18 | 1.00 | 0.32 | 0.04 | 0.72 | 0.89 | 0.23 | 17.00 | 1.62 | 1.29 | 9.54 | 7.72 | 7.48 | 7.58 | 11.38 | 9.96 | 4.82 | 1.40 | 6.55 | 0.28 | 0.18 | 6.67 | 7.05 | 0.06 | 0.05 | 0.06 | 0.06 | 2.62 | 1.17 | 0.74 | 0.34 | 0.26 | 0.49 | 0.62 | 0.45 | 2.21 | 1.39 | 0.56 | 0.07 | 0.36 | 1.76 | 0.11 | 3.99 | 0.49 | 11.77 | 0.84 | 0.21 | 2.25 | 0.34 | 0.19 | 0.74 | 1.33 | 0.58 | 0.42 | 0.18 | 0.07 | 0.24 | 0.51 | 0.50 | 0.47 | 0.60 | 1.38 | 0.69 | 3.64 | 3.16 | 0.67 | 3.24 | 0.00 | 1.24 | 1.06 | 0.24 | 2.52 | 0.18 | 0.13 | 0.27 | 0.10 | 0.12 | 0.11 | 0.16 | 0.15 | 0.21 | 0.07 | 1.39 | 0.04 | 7.37 | 0.07 | 7.47 | 0.37 | 0.19 | 12.14 | 2.40 | 0.19 | 4.67 | 3.01 | 0.27 | 0.26 | 2.33 | 4.35 |
| pg-src-16--2 | 0.55 | 0.39 | 3.37 | 0.26 | 0.09 | 1.11 | 4.73 | 0.38 | 0.07 | 1.06 | 1.28 | 0.64 | 0.62 | 1.96 | 0.63 | 0.17 | 0.93 | 0.34 | 0.04 | 2.00 | 0.95 | 0.21 | 16.71 | 1.63 | 1.30 | 9.48 | 7.80 | 7.49 | 7.60 | 11.03 | 9.77 | 4.79 | 1.34 | 6.36 | 3.97 | 0.20 | 6.57 | 7.12 | 0.07 | 0.06 | 0.06 | 0.06 | 2.54 | 1.13 | 0.64 | 0.33 | 0.25 | 0.48 | 0.60 | 0.44 | 2.13 | 1.35 | 0.56 | 0.07 | 0.81 | 1.76 | 0.11 | 3.91 | 0.47 | 11.43 | 0.76 | 0.16 | 2.03 | 0.34 | 0.23 | 0.48 | 1.02 | 0.56 | 2.34 | 0.08 | 0.08 | 0.44 | 0.48 | 0.47 | 0.43 | 0.58 | 4.53 | 0.66 | 12.22 | 3.11 | 0.64 | 3.22 | 0.00 | 1.22 | 1.03 | 0.76 | 2.48 | 0.17 | 0.12 | 0.26 | 0.10 | 0.12 | 0.10 | 0.17 | 0.16 | 0.22 | 0.06 | 1.27 | 0.03 | 6.42 | 0.07 | 6.52 | 0.27 | 0.20 | 11.95 | 2.30 | 0.20 | 4.82 | 3.15 | 2.64 | 0.28 | 2.42 | 4.42 |
| pg-src-17--2 | 0.54 | 0.38 | 3.11 | 0.27 | 0.09 | 1.12 | 4.64 | 0.39 | 0.06 | 1.08 | 1.32 | 0.67 | 0.66 | 2.06 | 0.67 | 0.18 | 1.05 | 0.32 | 0.04 | 0.72 | 0.89 | 0.22 | 17.40 | 1.65 | 1.29 | 9.55 | 7.82 | 7.51 | 7.67 | 11.31 | 9.98 | 0.50 | 1.35 | 6.36 | 3.82 | 0.17 | 6.46 | 7.02 | 0.06 | 0.05 | 0.06 | 0.05 | 2.57 | 1.15 | 0.69 | 0.35 | 0.25 | 0.49 | 0.60 | 0.44 | 2.29 | 1.45 | 0.56 | 0.08 | 0.35 | 1.78 | 0.06 | 4.00 | 0.48 | 11.69 | 0.38 | 0.21 | 2.15 | 0.34 | 0.24 | 0.73 | 0.95 | 0.58 | 0.43 | 0.12 | 0.07 | 1.59 | 0.51 | 0.47 | 0.44 | 0.60 | 11.47 | 0.68 | 11.51 | 3.20 | 0.66 | 3.29 | 0.00 | 1.26 | 19.43 | 0.92 | 1.02 | 0.18 | 0.12 | 0.26 | 0.10 | 0.12 | 0.11 | 0.16 | 0.15 | 0.21 | 0.06 | 1.35 | 0.04 | 7.08 | 0.07 | 7.17 | 0.25 | 0.19 | 11.95 | 2.32 | 0.19 | 4.78 | 2.99 | 2.52 | 0.26 | 2.31 | 4.51 |
| pg-src-17--3 | 0.56 | 0.39 | 3.10 | 0.26 | 0.09 | 1.12 | 4.65 | 0.39 | 0.06 | 1.09 | 1.36 | 0.68 | 0.67 | 2.08 | 0.66 | 0.17 | 0.99 | 0.31 | 0.04 | 0.72 | 0.89 | 0.23 | 17.29 | 1.62 | 1.29 | 9.54 | 7.75 | 7.61 | 7.74 | 11.45 | 10.20 | 4.80 | 1.53 | 6.56 | 0.27 | 0.19 | 6.67 | 7.14 | 0.06 | 0.05 | 0.06 | 0.05 | 2.64 | 1.17 | 0.86 | 0.34 | 0.26 | 0.49 | 0.61 | 0.45 | 2.20 | 1.40 | 0.56 | 0.07 | 0.81 | 1.76 | 0.06 | 4.02 | 0.49 | 11.82 | 0.43 | 0.21 | 1.24 | 0.34 | 0.14 | 0.74 | 1.14 | 0.59 | 1.18 | 0.18 | 0.07 | 0.21 | 0.51 | 0.48 | 0.45 | 0.62 | 3.00 | 0.66 | 12.03 | 3.19 | 0.67 | 3.26 | 0.00 | 1.26 | 0.26 | 2.89 | 2.52 | 0.18 | 0.12 | 0.27 | 0.10 | 0.12 | 0.11 | 0.16 | 0.15 | 0.21 | 0.06 | 1.39 | 0.04 | 7.40 | 0.07 | 7.54 | 0.37 | 0.19 | 12.47 | 2.39 | 0.19 | 4.76 | 3.03 | 0.26 | 0.25 | 2.31 | 4.36 |
| pg-src-16--3 | 0.56 | 0.40 | 3.41 | 0.26 | 0.24 | 1.11 | 4.67 | 0.39 | 0.06 | 1.09 | 1.31 | 0.67 | 0.64 | 2.01 | 0.65 | 0.17 | 1.01 | 0.33 | 0.04 | 0.86 | 0.95 | 0.23 | 17.41 | 1.63 | 1.30 | 9.72 | 7.81 | 7.45 | 7.59 | 11.32 | 10.07 | 4.78 | 1.38 | 6.45 | 4.04 | 0.20 | 6.77 | 7.11 | 0.07 | 0.06 | 0.06 | 0.06 | 2.58 | 1.14 | 0.66 | 0.34 | 0.25 | 0.48 | 0.64 | 0.48 | 2.23 | 1.43 | 0.58 | 0.07 | 0.83 | 1.79 | 0.06 | 3.96 | 0.48 | 12.33 | 0.79 | 0.16 | 2.12 | 0.34 | 0.21 | 0.73 | 0.96 | 0.85 | 2.36 | 0.09 | 0.08 | 0.21 | 0.49 | 0.48 | 0.46 | 0.61 | 3.25 | 0.68 | 3.33 | 3.13 | 0.65 | 3.21 | 0.00 | 1.23 | 2.56 | 3.93 | 2.52 | 0.17 | 0.12 | 0.26 | 0.10 | 0.12 | 0.10 | 0.17 | 0.16 | 0.22 | 0.06 | 1.32 | 0.03 | 6.66 | 0.07 | 6.76 | 0.27 | 0.20 | 12.28 | 2.38 | 0.20 | 4.84 | 3.15 | 2.60 | 1.62 | 2.44 | 4.45 |
Benchmark sysbench| Instance | load_bulk_insert_tps | load_oltp_delete_tps | load_oltp_insert_tps | load_oltp_point_select_tps | load_oltp_read_only_tps | load_oltp_read_write_tps | load_oltp_update_index_tps | load_oltp_update_non_index_tps | load_oltp_write_only_tps | load_select_random_points_tps | load_select_random_ranges_tps | load_bulk_insert_ops | load_oltp_delete_ops | load_oltp_insert_ops | load_oltp_point_select_ops | load_oltp_read_only_ops | load_oltp_read_write_ops | load_oltp_update_index_ops | load_oltp_update_non_index_ops | load_oltp_write_only_ops | load_select_random_points_ops | load_select_random_ranges_ops |
|---|
| pg-src-16--1 | 2301055.49 | 363083.34 | 129529.90 | 350186.40 | 14790.42 | 9114.07 | 151996.60 | 181013.85 | 26731.41 | 219017.92 | 145669.32 | 80.88 | 363083.34 | 129529.90 | 350186.40 | 236646.68 | 182366.31 | 151996.60 | 181013.85 | 160669.21 | 219017.92 | 145669.32 |
| pg-src-17--1 | 2446620.01 | 375621.33 | 132038.12 | 361167.19 | 14863.40 | 8700.89 | 148284.22 | 176604.48 | 24211.98 | 258105.58 | 145816.03 | 86.44 | 375621.33 | 132038.12 | 361167.19 | 237814.40 | 174104.19 | 148284.22 | 176604.48 | 145515.11 | 258105.58 | 145816.03 |
| pg-src-16--2 | 2279280.70 | 355192.93 | 128063.25 | 345159.44 | 14526.72 | 8749.06 | 151061.36 | 176716.22 | 28854.06 | 214867.22 | 143813.30 | 80.05 | 355192.93 | 128063.25 | 345159.44 | 232427.49 | 175060.96 | 151061.36 | 176716.22 | 173423.74 | 214867.22 | 143813.30 |
| pg-src-17--2 | 2404438.19 | 363141.20 | 131567.56 | 354956.01 | 15170.48 | 9329.29 | 152016.58 | 182651.35 | 26587.73 | 262444.51 | 147997.27 | 84.84 | 363141.20 | 131567.56 | 354956.01 | 242727.63 | 186677.78 | 152016.58 | 182651.35 | 159806.80 | 262444.51 | 147997.27 |
| pg-src-17--3 | 2437419.33 | 374866.77 | 131954.54 | 359678.70 | 15146.24 | 9557.85 | 152596.39 | 182232.16 | 27710.46 | 262210.36 | 149833.13 | 86.10 | 374866.77 | 131954.54 | 359678.70 | 242339.84 | 191256.66 | 152596.39 | 182232.16 | 166553.32 | 262210.36 | 149833.13 |
| pg-src-16--3 | 2327793.41 | 361423.06 | 130645.37 | 342774.09 | 14829.44 | 9058.74 | 151516.42 | 175200.26 | 28415.96 | 217407.97 | 143831.95 | 81.91 | 361423.06 | 130645.37 | 342774.09 | 237270.97 | 181260.56 | 151516.42 | 175200.26 | 170793.22 | 217407.97 | 143831.95 |
Benchmark insert-1m| Instance | time |
|---|
| pg-src-16--1 | 37.15 |
| pg-src-17--1 | 35.22 |
| pg-src-16--2 | 34.47 |
| pg-src-17--2 | 34.70 |
| pg-src-17--3 | 33.38 |
| pg-src-16--3 | 38.38 |
