You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
According to @Kobzol 's blog, The main function of helloworld-tiny and ripgrep-13.0.0-tiny are to monitor the size of Rust executable
Refer to blog: There are also two secondary benchmarks (helloworld-tiny and ripgrep-13.0.0-tiny), which exist solely to monitor the size of a “minimal-sized” Rust executable, which is compiled with compiler flags that should favour small executable size.
However, on the graphs page, the title states 'Benchmarks for artifact sizes', but the metric displayed is "CPU instructions", which confuses me.
I believe it should present the value of size:xxxxxx.
Solutions I come up with
(Simple) Write a note below the title explaining that it only makes sense when the kind is size:xxxxxx.
We should separate the APIs and let them have their own behavior
Hi, the whole graphs page is displayed with a single metric, so if you choose instructions, you'll see instruction counts for all the benchmarks.
While the binary size of these tiny benchmarks is indeed the main motivation for why we have added them, their compilation time ia actually not uninteresting! They use different compiler flags, and LTO, so it is also interesting to look at how does their compilation time change.
@Kobzol Thanks for explanation.
Then, I think none of my solutions is feasible for this issue.
But I still think the title "Benchmarks for artifact sizes" confuses the user (damage UX).
What about we delete this category?
According to @Kobzol 's blog, The main function of
helloworld-tiny
andripgrep-13.0.0-tiny
are to monitor the size of Rust executableHowever, on the graphs page, the title states 'Benchmarks for artifact sizes', but the metric displayed is "CPU instructions", which confuses me.
I believe it should present the value of
size:xxxxxx
.Solutions I come up with
kind
issize:xxxxxx
.related to : #1817
The text was updated successfully, but these errors were encountered: