Skip to content

Commit

Permalink
moo/criterion/0b5a8f2
Browse files Browse the repository at this point in the history
  • Loading branch information
@hinto-janai
hinto-janai committed Dec 3, 2024
1 parent 0b5a8f2 commit 81a24cd
Show file tree
Hide file tree
Showing 2,135 changed files with 155,642 additions and 17 deletions.
9 changes: 6 additions & 3 deletions README.md
View file
Original file line number Diff line number Diff line change
@@ -1,13 +1,16 @@
# Benches
## Benches
This repository contains Cuprate's benchmarks and benchmarking utilities.

See the [`Benchmarking` section in the Architecture book](https://architecture.cuprate.org/benchmarking/intro.html) for documentation.

# Run all benchmarks
## Run all benchmarks
```bash
# Run all Criterion benchmarks.
cargo bench

# Run all `cuprate-benchmark` benchmarks.
cargo run --release --package cuprate-benchmark --features all
```
```

## Results
See `/docs` or <https://benches.hinto.rs> for historical benchmark data.
22 changes: 22 additions & 0 deletions docs/README.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
Historical benchmarking data for Cuprate.

### Directory structure
```
$MACHINE_NAME/
├── criterion/
│ └── $COMMIT_1..$COMMIT_2/
│ └── $CRITERION_DATA
└── benchmarks/
└── $COMMIT/
└── $BENCHMARKING_DATA
```

- The top-level directories are named after the machines being used
- Each top-level directory have 2 sub-directories: `criterion` and `benchmarks`
- Within `criterion`, the data is placed in directories with the `Cuprate/cuprate` commits being compared
- Within `benchmarks`, the data is placed in directories with the `Cuprate/cuprate` commit used

### Machines
| Machine name/directory | CPU | Core/thread count | Memory | Disk |
|------------------------|------------------------|-------------------|--------|------|
| moo | Intel Xeon E5 2698 v3 | 8/16 | 32 GB | NVMe SSD
1 change: 1 addition & 0 deletions docs/moo/criterion/0b5a8f2/criterion/add_alt_block_v16_tx0/base/benchmark.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"group_id":"add_alt_block_v16_tx0","function_id":null,"value_str":null,"throughput":null,"full_id":"add_alt_block_v16_tx0","directory_name":"add_alt_block_v16_tx0","title":"add_alt_block_v16_tx0"}
1 change: 1 addition & 0 deletions docs/moo/criterion/0b5a8f2/criterion/add_alt_block_v16_tx0/base/estimates.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":3608.313326373283,"upper_bound":3830.544636746379},"point_estimate":3720.19768618528,"standard_error":56.45998647494982},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":3715.147772606383,"upper_bound":3889.7925967261904},"point_estimate":3830.8820557004474,"standard_error":46.23293460088066},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":271.8637131733038,"upper_bound":759.0239164557456},"point_estimate":443.4910523274691,"standard_error":139.4086241004477},"slope":{"confidence_interval":{"confidence_level":0.95,"lower_bound":4047.0778325693122,"upper_bound":4238.97332171486},"point_estimate":4146.568768587446,"standard_error":48.930834011076506},"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":487.3348231053236,"upper_bound":643.3706572002536},"point_estimate":569.7967147379321,"standard_error":40.03388845100845}}
1 change: 1 addition & 0 deletions docs/moo/criterion/0b5a8f2/criterion/add_alt_block_v16_tx0/base/sample.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"sampling_mode":"Linear","iters":[128.0,256.0,384.0,512.0,640.0,768.0,896.0,1024.0,1152.0,1280.0,1408.0,1536.0,1664.0,1792.0,1920.0,2048.0,2176.0,2304.0,2432.0,2560.0,2688.0,2816.0,2944.0,3072.0,3200.0,3328.0,3456.0,3584.0,3712.0,3840.0,3968.0,4096.0,4224.0,4352.0,4480.0,4608.0,4736.0,4864.0,4992.0,5120.0,5248.0,5376.0,5504.0,5632.0,5760.0,5888.0,6016.0,6144.0,6272.0,6400.0,6528.0,6656.0,6784.0,6912.0,7040.0,7168.0,7296.0,7424.0,7552.0,7680.0,7808.0,7936.0,8064.0,8192.0,8320.0,8448.0,8576.0,8704.0,8832.0,8960.0,9088.0,9216.0,9344.0,9472.0,9600.0,9728.0,9856.0,9984.0,10112.0,10240.0,10368.0,10496.0,10624.0,10752.0,10880.0,11008.0,11136.0,11264.0,11392.0,11520.0,11648.0,11776.0,11904.0,12032.0,12160.0,12288.0,12416.0,12544.0,12672.0,12800.0],"times":[283498.0,583137.0,961353.0,1340927.0,1724497.0,2121033.0,2504141.0,2884662.0,3339291.0,3856467.0,4194298.0,4509119.0,4942163.0,5290067.0,5883265.0,6300629.0,6747716.0,7322599.0,7749359.0,8405773.0,8562946.0,9138545.0,9479389.0,9920843.0,10595594.0,11165003.0,11363108.0,12311521.0,13438576.0,14130570.0,13569720.0,14968583.0,14994464.0,16148596.0,16121717.0,16210877.0,16852012.0,17282320.0,17873719.0,18559339.0,19525623.0,20911525.0,21141936.0,21578320.0,21828183.0,21959392.0,22350329.0,23652602.0,24410388.0,25274399.0,24616866.0,25926560.0,26575043.0,27491967.0,26751532.0,27216455.0,28245818.0,28303448.0,28638207.0,29620247.0,29907656.0,30694692.0,32043275.0,33720293.0,36430457.0,36381241.0,37278004.0,37497644.0,37479166.0,38560771.0,40275898.0,36792060.0,36303876.0,36856802.0,37328983.0,37906850.0,38252479.0,40621213.0,39998189.0,40086644.0,40778966.0,41498592.0,41689291.0,42368744.0,43027202.0,43716203.0,44249103.0,57936349.0,52424188.0,51111579.0,51395612.0,55713363.0,53758942.0,55805647.0,53150375.0,55135639.0,55748251.0,58060646.0,56704673.0,58875772.0]}
1 change: 1 addition & 0 deletions docs/moo/criterion/0b5a8f2/criterion/add_alt_block_v16_tx0/base/tukey.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
[1300.673584998176,2303.000007198162,4975.870466398125,5978.196888598111]
1 change: 1 addition & 0 deletions docs/moo/criterion/0b5a8f2/criterion/add_alt_block_v16_tx0/new/benchmark.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"group_id":"add_alt_block_v16_tx0","function_id":null,"value_str":null,"throughput":null,"full_id":"add_alt_block_v16_tx0","directory_name":"add_alt_block_v16_tx0","title":"add_alt_block_v16_tx0"}
1 change: 1 addition & 0 deletions docs/moo/criterion/0b5a8f2/criterion/add_alt_block_v16_tx0/new/estimates.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"mean":{"confidence_interval":{"confidence_level":0.95,"lower_bound":3608.313326373283,"upper_bound":3830.544636746379},"point_estimate":3720.19768618528,"standard_error":56.45998647494982},"median":{"confidence_interval":{"confidence_level":0.95,"lower_bound":3715.147772606383,"upper_bound":3889.7925967261904},"point_estimate":3830.8820557004474,"standard_error":46.23293460088066},"median_abs_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":271.8637131733038,"upper_bound":759.0239164557456},"point_estimate":443.4910523274691,"standard_error":139.4086241004477},"slope":{"confidence_interval":{"confidence_level":0.95,"lower_bound":4047.0778325693122,"upper_bound":4238.97332171486},"point_estimate":4146.568768587446,"standard_error":48.930834011076506},"std_dev":{"confidence_interval":{"confidence_level":0.95,"lower_bound":487.3348231053236,"upper_bound":643.3706572002536},"point_estimate":569.7967147379321,"standard_error":40.03388845100845}}
1 change: 1 addition & 0 deletions docs/moo/criterion/0b5a8f2/criterion/add_alt_block_v16_tx0/new/sample.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"sampling_mode":"Linear","iters":[128.0,256.0,384.0,512.0,640.0,768.0,896.0,1024.0,1152.0,1280.0,1408.0,1536.0,1664.0,1792.0,1920.0,2048.0,2176.0,2304.0,2432.0,2560.0,2688.0,2816.0,2944.0,3072.0,3200.0,3328.0,3456.0,3584.0,3712.0,3840.0,3968.0,4096.0,4224.0,4352.0,4480.0,4608.0,4736.0,4864.0,4992.0,5120.0,5248.0,5376.0,5504.0,5632.0,5760.0,5888.0,6016.0,6144.0,6272.0,6400.0,6528.0,6656.0,6784.0,6912.0,7040.0,7168.0,7296.0,7424.0,7552.0,7680.0,7808.0,7936.0,8064.0,8192.0,8320.0,8448.0,8576.0,8704.0,8832.0,8960.0,9088.0,9216.0,9344.0,9472.0,9600.0,9728.0,9856.0,9984.0,10112.0,10240.0,10368.0,10496.0,10624.0,10752.0,10880.0,11008.0,11136.0,11264.0,11392.0,11520.0,11648.0,11776.0,11904.0,12032.0,12160.0,12288.0,12416.0,12544.0,12672.0,12800.0],"times":[283498.0,583137.0,961353.0,1340927.0,1724497.0,2121033.0,2504141.0,2884662.0,3339291.0,3856467.0,4194298.0,4509119.0,4942163.0,5290067.0,5883265.0,6300629.0,6747716.0,7322599.0,7749359.0,8405773.0,8562946.0,9138545.0,9479389.0,9920843.0,10595594.0,11165003.0,11363108.0,12311521.0,13438576.0,14130570.0,13569720.0,14968583.0,14994464.0,16148596.0,16121717.0,16210877.0,16852012.0,17282320.0,17873719.0,18559339.0,19525623.0,20911525.0,21141936.0,21578320.0,21828183.0,21959392.0,22350329.0,23652602.0,24410388.0,25274399.0,24616866.0,25926560.0,26575043.0,27491967.0,26751532.0,27216455.0,28245818.0,28303448.0,28638207.0,29620247.0,29907656.0,30694692.0,32043275.0,33720293.0,36430457.0,36381241.0,37278004.0,37497644.0,37479166.0,38560771.0,40275898.0,36792060.0,36303876.0,36856802.0,37328983.0,37906850.0,38252479.0,40621213.0,39998189.0,40086644.0,40778966.0,41498592.0,41689291.0,42368744.0,43027202.0,43716203.0,44249103.0,57936349.0,52424188.0,51111579.0,51395612.0,55713363.0,53758942.0,55805647.0,53150375.0,55135639.0,55748251.0,58060646.0,56704673.0,58875772.0]}
1 change: 1 addition & 0 deletions docs/moo/criterion/0b5a8f2/criterion/add_alt_block_v16_tx0/new/tukey.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
[1300.673584998176,2303.000007198162,4975.870466398125,5978.196888598111]
80 changes: 80 additions & 0 deletions docs/moo/criterion/0b5a8f2/criterion/add_alt_block_v16_tx0/report/MAD.svg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 81a24cd

Please sign in to comment.