Skip to content

Latest commit

 

History

History
196 lines (168 loc) · 22.3 KB

bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0-vs-3.13.0rc2.md

File metadata and controls

196 lines (168 loc) · 22.3 KB

Results vs. 3.13.0rc2

  • fork: python
  • ref: 3f2cfd0462e13368092a
  • machine: linux-x86_64
  • commit hash: 3f2cfd0
  • commit date: 2025-01-25
  • overall geometric mean: 1.030x faster
  • HPT reliability: 99.95%
  • HPT 99th percentile: 1.01x faster
  • Memory change: 1.13x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0
2to3 445 ms 531 ms: 1.19x slower
docutils 4.01 sec 3.67 sec: 1.09x faster
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (1): html5lib

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0
async_tree_io 1.39 sec 885 ms: 1.57x faster
async_tree_io_tg 1.40 sec 954 ms: 1.47x faster
async_tree_none 572 ms 395 ms: 1.45x faster
async_tree_memoization_tg 670 ms 504 ms: 1.33x faster
async_tree_memoization 709 ms 566 ms: 1.25x faster
async_tree_cpu_io_mixed 889 ms 710 ms: 1.25x faster
async_tree_cpu_io_mixed_tg 852 ms 701 ms: 1.21x faster
async_tree_none_tg 504 ms 431 ms: 1.17x faster
async_generators 567 ms 529 ms: 1.07x faster
coroutines 30.9 ms 33.1 ms: 1.07x slower
Geometric mean (ref) 1.19x faster

Benchmark hidden because not significant (3): asyncio_tcp_ssl, asyncio_websockets, asyncio_tcp

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0
float 116 ms 123 ms: 1.06x slower
Geometric mean (ref) 1.00x slower

Benchmark hidden because not significant (2): nbody, pidigits

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0
regex_compile 182 ms 159 ms: 1.15x faster
regex_v8 32.8 ms 35.1 ms: 1.07x slower
Geometric mean (ref) 1.01x faster

Benchmark hidden because not significant (2): regex_effbot, regex_dna

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0
xml_etree_parse 231 ms 195 ms: 1.18x faster
xml_etree_iterparse 177 ms 153 ms: 1.16x faster
tomli_loads 2.78 sec 2.44 sec: 1.14x faster
xml_etree_generate 122 ms 114 ms: 1.08x faster
pickle_dict 47.2 us 51.2 us: 1.09x slower
pickle_pure_python 416 us 456 us: 1.09x slower
pickle_list 6.86 us 7.62 us: 1.11x slower
unpickle_list 6.68 us 7.50 us: 1.12x slower
pickle 15.1 us 17.3 us: 1.14x slower
json_loads 34.3 us 39.1 us: 1.14x slower
json_dumps 14.1 ms 17.9 ms: 1.27x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (3): unpickle_pure_python, unpickle, xml_etree_process

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0
python_startup_no_site 15.3 ms 16.0 ms: 1.04x slower
python_startup 22.4 ms 29.3 ms: 1.31x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0
genshi_xml 72.1 ms 66.6 ms: 1.08x faster
mako 15.9 ms 16.7 ms: 1.05x slower
django_template 44.3 ms 50.5 ms: 1.14x slower
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (1): genshi_text

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0
async_tree_io 1.39 sec 885 ms: 1.57x faster
async_tree_io_tg 1.40 sec 954 ms: 1.47x faster
async_tree_none 572 ms 395 ms: 1.45x faster
deepcopy 498 us 371 us: 1.34x faster
async_tree_memoization_tg 670 ms 504 ms: 1.33x faster
async_tree_memoization 709 ms 566 ms: 1.25x faster
unpack_sequence 74.3 ns 59.3 ns: 1.25x faster
async_tree_cpu_io_mixed 889 ms 710 ms: 1.25x faster
pylint 470 ms 381 ms: 1.23x faster
async_tree_cpu_io_mixed_tg 852 ms 701 ms: 1.21x faster
xml_etree_parse 231 ms 195 ms: 1.18x faster
async_tree_none_tg 504 ms 431 ms: 1.17x faster
telco 12.2 ms 10.5 ms: 1.16x faster
xml_etree_iterparse 177 ms 153 ms: 1.16x faster
richards 65.5 ms 56.7 ms: 1.15x faster
regex_compile 182 ms 159 ms: 1.15x faster
spectral_norm 157 ms 137 ms: 1.14x faster
tomli_loads 2.78 sec 2.44 sec: 1.14x faster
sqlglot_parse 1.76 ms 1.57 ms: 1.12x faster
typing_runtime_protocols 226 us 203 us: 1.11x faster
deepcopy_reduce 4.10 us 3.71 us: 1.10x faster
deepcopy_memo 50.1 us 45.7 us: 1.10x faster
richards_super 73.2 ms 66.8 ms: 1.10x faster
scimark_sor 179 ms 163 ms: 1.10x faster
docutils 4.01 sec 3.67 sec: 1.09x faster
meteor_contest 150 ms 137 ms: 1.09x faster
go 191 ms 176 ms: 1.09x faster
genshi_xml 72.1 ms 66.6 ms: 1.08x faster
xml_etree_generate 122 ms 114 ms: 1.08x faster
async_generators 567 ms 529 ms: 1.07x faster
sqlglot_optimize 74.7 ms 69.8 ms: 1.07x faster
deltablue 4.44 ms 4.19 ms: 1.06x faster
mdp 3.80 sec 3.60 sec: 1.06x faster
scimark_monte_carlo 90.6 ms 86.5 ms: 1.05x faster
bpe_tokeniser 6.28 sec 6.00 sec: 1.05x faster
pyflate 664 ms 639 ms: 1.04x faster
pprint_pformat 1.94 sec 1.88 sec: 1.04x faster
python_startup_no_site 15.3 ms 16.0 ms: 1.04x slower
scimark_lu 146 ms 153 ms: 1.05x slower
mako 15.9 ms 16.7 ms: 1.05x slower
thrift 1.10 ms 1.15 ms: 1.05x slower
nqueens 112 ms 118 ms: 1.06x slower
float 116 ms 123 ms: 1.06x slower
sqlglot_transpile 2.20 ms 2.33 ms: 1.06x slower
hexiom 8.11 ms 8.63 ms: 1.06x slower
regex_v8 32.8 ms 35.1 ms: 1.07x slower
coroutines 30.9 ms 33.1 ms: 1.07x slower
dulwich_log 93.7 ms 101 ms: 1.08x slower
crypto_pyaes 100 ms 108 ms: 1.08x slower
sqlglot_normalize 140 ms 151 ms: 1.08x slower
pickle_dict 47.2 us 51.2 us: 1.09x slower
comprehensions 22.2 us 24.2 us: 1.09x slower
generators 40.0 ms 43.6 ms: 1.09x slower
pickle_pure_python 416 us 456 us: 1.09x slower
logging_simple 8.56 us 9.37 us: 1.09x slower
pickle_list 6.86 us 7.62 us: 1.11x slower
json 6.51 ms 7.28 ms: 1.12x slower
unpickle_list 6.68 us 7.50 us: 1.12x slower
pickle 15.1 us 17.3 us: 1.14x slower
django_template 44.3 ms 50.5 ms: 1.14x slower
json_loads 34.3 us 39.1 us: 1.14x slower
coverage 107 ms 123 ms: 1.15x slower
bench_thread_pool 2.89 ms 3.35 ms: 1.16x slower
logging_silent 130 ns 153 ns: 1.18x slower
2to3 445 ms 531 ms: 1.19x slower
json_dumps 14.1 ms 17.9 ms: 1.27x slower
python_startup 22.4 ms 29.3 ms: 1.31x slower
gc_traversal 5.70 ms 9.82 ms: 1.72x slower
create_gc_cycles 2.41 ms 4.18 ms: 1.73x slower
bench_mp_pool 18.7 ms 97.4 ms: 5.21x slower
Geometric mean (ref) 1.00x slower

Benchmark hidden because not significant (26): genshi_text, sympy_str, nbody, pidigits, pprint_safe_repr, fannkuch, pathlib, html5lib, sympy_integrate, logging_format, unpickle_pure_python, sqlite_synth, raytrace, sympy_expand, regex_effbot, scimark_fft, unpickle, regex_dna, xml_etree_process, asyncio_tcp_ssl, sympy_sum, pycparser, chaos, asyncio_websockets, scimark_sparse_mat_mult, asyncio_tcp Ignored benchmarks (6) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, chameleon, dask, flaskblogging, gunicorn, tornado_http Ignored benchmarks (8) of results/bm-20250125-3.14.0a4+-3f2cfd0/bm-20250125-linux-x86_64-python-3f2cfd0462e13368092a-3.14.0a4+-3f2cfd0.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers

  • Geometric mean (including insignificant results): 1.030x faster

HPT report

  • Reliability score: 99.95% likely to be faster
  • 90% likely to have a speedup of 1.02x
  • 95% likely to have a speedup of 1.02x
  • 99% likely to have a speedup of 1.01x

Memory

  • memory change: 1.13x