Skip to content

Latest commit

 

History

History
211 lines (185 loc) · 39.5 KB

bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-base.md

File metadata and controls

211 lines (185 loc) · 39.5 KB

Results vs. base

  • fork: python
  • ref: 3f2cfd0462e13368092a
  • machine: linux-x86_64
  • commit hash: 3f2cfd0
  • commit date: 2025-01-25
  • overall geometric mean: 1.158x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.15x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json
2to3 531 ms 570 ms: 1.07x slower
docutils 3.67 sec 4.20 sec: 1.15x slower
html5lib 91.4 ms 118 ms: 1.29x slower
sphinx 1.40 sec 1.64 sec: 1.17x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json
async_tree_io_tg 954 ms 896 ms: 1.06x faster
coroutines 33.1 ms 34.8 ms: 1.05x slower
async_tree_memoization_tg 504 ms 541 ms: 1.07x slower
asyncio_tcp 981 ms 1.05 sec: 1.08x slower
async_tree_none 395 ms 454 ms: 1.15x slower
async_tree_cpu_io_mixed 710 ms 825 ms: 1.16x slower
async_generators 529 ms 619 ms: 1.17x slower
asyncio_tcp_ssl 2.82 sec 3.44 sec: 1.22x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (5): async_tree_none_tg, asyncio_websockets, async_tree_memoization, async_tree_cpu_io_mixed_tg, async_tree_io

Benchmarks with tag 'math':

Benchmark results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json
nbody 116 ms 198 ms: 1.71x slower
Geometric mean (ref) 1.17x slower

Benchmark hidden because not significant (2): float, pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json
regex_v8 35.1 ms 33.3 ms: 1.05x faster
regex_dna 286 ms 304 ms: 1.06x slower
regex_compile 159 ms 201 ms: 1.27x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (1): regex_effbot

Benchmarks with tag 'serialize':

Benchmark results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json
pickle 17.3 us 15.7 us: 1.10x faster
pickle_dict 51.2 us 47.4 us: 1.08x faster
pickle_list 7.62 us 7.14 us: 1.07x faster
json_dumps 17.9 ms 16.9 ms: 1.06x faster
xml_etree_process 87.2 ms 98.9 ms: 1.13x slower
xml_etree_parse 195 ms 225 ms: 1.15x slower
pickle_pure_python 456 us 548 us: 1.20x slower
json_loads 39.1 us 47.8 us: 1.22x slower
unpickle_pure_python 290 us 359 us: 1.24x slower
tomli_loads 2.44 sec 3.04 sec: 1.24x slower
xml_etree_generate 114 ms 150 ms: 1.32x slower
Geometric mean (ref) 1.08x slower

Benchmark hidden because not significant (3): unpickle, unpickle_list, xml_etree_iterparse

Benchmarks with tag 'startup':

Benchmark results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json
python_startup 29.3 ms 36.0 ms: 1.23x slower
python_startup_no_site 16.0 ms 23.1 ms: 1.45x slower
Geometric mean (ref) 1.33x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json
django_template 50.5 ms 59.6 ms: 1.18x slower
genshi_text 30.6 ms 42.4 ms: 1.39x slower
mako 16.7 ms 24.8 ms: 1.48x slower
genshi_xml 66.6 ms 101 ms: 1.51x slower
Geometric mean (ref) 1.38x slower

All benchmarks:

Benchmark results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json results/bm-20250125-3.14.0a4+-3f2cfd0-NOGIL/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json
gc_traversal 9.82 ms 7.46 ms: 1.32x faster
create_gc_cycles 4.18 ms 3.21 ms: 1.30x faster
pickle 17.3 us 15.7 us: 1.10x faster
pickle_dict 51.2 us 47.4 us: 1.08x faster
pickle_list 7.62 us 7.14 us: 1.07x faster
async_tree_io_tg 954 ms 896 ms: 1.06x faster
json_dumps 17.9 ms 16.9 ms: 1.06x faster
regex_v8 35.1 ms 33.3 ms: 1.05x faster
coroutines 33.1 ms 34.8 ms: 1.05x slower
k_core 4.25 sec 4.51 sec: 1.06x slower
regex_dna 286 ms 304 ms: 1.06x slower
sqlglot_normalize 151 ms 162 ms: 1.07x slower
2to3 531 ms 570 ms: 1.07x slower
async_tree_memoization_tg 504 ms 541 ms: 1.07x slower
subparsers 32.8 ms 35.3 ms: 1.07x slower
asyncio_tcp 981 ms 1.05 sec: 1.08x slower
bench_mp_pool 97.4 ms 105 ms: 1.08x slower
dulwich_log 101 ms 111 ms: 1.10x slower
scimark_sor 163 ms 180 ms: 1.10x slower
generators 43.6 ms 49.3 ms: 1.13x slower
xml_etree_process 87.2 ms 98.9 ms: 1.13x slower
pathlib 29.5 ms 33.6 ms: 1.14x slower
docutils 3.67 sec 4.20 sec: 1.15x slower
async_tree_none 395 ms 454 ms: 1.15x slower
xml_etree_parse 195 ms 225 ms: 1.15x slower
scimark_lu 153 ms 176 ms: 1.15x slower
deepcopy 371 us 429 us: 1.16x slower
async_tree_cpu_io_mixed 710 ms 825 ms: 1.16x slower
sympy_str 368 ms 428 ms: 1.16x slower
sphinx 1.40 sec 1.64 sec: 1.17x slower
sympy_expand 603 ms 706 ms: 1.17x slower
shortest_path 934 ms 1.09 sec: 1.17x slower
async_generators 529 ms 619 ms: 1.17x slower
django_template 50.5 ms 59.6 ms: 1.18x slower
mdp 3.60 sec 4.25 sec: 1.18x slower
pprint_safe_repr 968 ms 1.14 sec: 1.18x slower
scimark_fft 478 ms 571 ms: 1.20x slower
pickle_pure_python 456 us 548 us: 1.20x slower
pyflate 639 ms 771 ms: 1.21x slower
crypto_pyaes 108 ms 131 ms: 1.21x slower
sympy_sum 214 ms 259 ms: 1.21x slower
asyncio_tcp_ssl 2.82 sec 3.44 sec: 1.22x slower
json_loads 39.1 us 47.8 us: 1.22x slower
spectral_norm 137 ms 168 ms: 1.22x slower
python_startup 29.3 ms 36.0 ms: 1.23x slower
connected_components 788 ms 972 ms: 1.23x slower
unpickle_pure_python 290 us 359 us: 1.24x slower
pylint 381 ms 474 ms: 1.24x slower
tomli_loads 2.44 sec 3.04 sec: 1.24x slower
coverage 123 ms 154 ms: 1.25x slower
thrift 1.15 ms 1.45 ms: 1.26x slower
logging_format 9.16 us 11.5 us: 1.26x slower
regex_compile 159 ms 201 ms: 1.27x slower
telco 10.5 ms 13.3 ms: 1.27x slower
go 176 ms 224 ms: 1.27x slower
json 7.28 ms 9.28 ms: 1.27x slower
comprehensions 24.2 us 31.0 us: 1.28x slower
richards_super 66.8 ms 85.5 ms: 1.28x slower
scimark_sparse_mat_mult 6.93 ms 8.88 ms: 1.28x slower
fannkuch 537 ms 692 ms: 1.29x slower
html5lib 91.4 ms 118 ms: 1.29x slower
many_optionals 1.23 ms 1.59 ms: 1.30x slower
xml_etree_generate 114 ms 150 ms: 1.32x slower
pprint_pformat 1.88 sec 2.47 sec: 1.32x slower
deepcopy_memo 45.7 us 60.4 us: 1.32x slower
sympy_integrate 29.9 ms 39.9 ms: 1.33x slower
sqlglot_transpile 2.33 ms 3.12 ms: 1.33x slower
sqlglot_optimize 69.8 ms 93.3 ms: 1.34x slower
unpack_sequence 59.3 ns 79.7 ns: 1.34x slower
typing_runtime_protocols 203 us 276 us: 1.36x slower
bench_thread_pool 3.35 ms 4.58 ms: 1.37x slower
bpe_tokeniser 6.00 sec 8.26 sec: 1.38x slower
raytrace 346 ms 478 ms: 1.38x slower
sqlalchemy_declarative 172 ms 239 ms: 1.38x slower
genshi_text 30.6 ms 42.4 ms: 1.39x slower
chaos 85.4 ms 118 ms: 1.39x slower
meteor_contest 137 ms 192 ms: 1.40x slower
python_startup_no_site 16.0 ms 23.1 ms: 1.45x slower
deepcopy_reduce 3.71 us 5.46 us: 1.47x slower
mako 16.7 ms 24.8 ms: 1.48x slower
hexiom 8.63 ms 12.8 ms: 1.49x slower
richards 56.7 ms 84.3 ms: 1.49x slower
genshi_xml 66.6 ms 101 ms: 1.51x slower
scimark_monte_carlo 86.5 ms 135 ms: 1.56x slower
logging_simple 9.37 us 14.6 us: 1.56x slower
sqlglot_parse 1.57 ms 2.46 ms: 1.57x slower
sqlalchemy_imperative 24.5 ms 38.6 ms: 1.57x slower
nbody 116 ms 198 ms: 1.71x slower
deltablue 4.19 ms 7.27 ms: 1.74x slower
Geometric mean (ref) 1.19x slower

Benchmark hidden because not significant (15): float, async_tree_none_tg, asyncio_websockets, sqlite_synth, pidigits, async_tree_memoization, async_tree_cpu_io_mixed_tg, regex_effbot, async_tree_io, unpickle, logging_silent, pycparser, unpickle_list, xml_etree_iterparse, nqueens

  • Geometric mean (including insignificant results): 1.158x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.16x
  • 95% likely to have a slowdown of 1.16x
  • 99% likely to have a slowdown of 1.15x

Memory

  • memory change: 1.19x