Adhoc Dashboard

[stanbrub]

Using the Deephaven UI, develop an Adhoc Dashboard that allows users to visualize comparisons they run with adhoc auto provision.

• Allow selection of the data sets (e.g. actor and set filters)
• Load selected data on apply
• Show a table for comparison for rates and variability for like benchmarks
• Show hardware, jvm, dependency diffs
• Allow clicking a benchmark in the table to show a chart of the runs that make up the sets (one set per series)

Related:

• Collect Basic GC, JIT, and Heap Metrics #382
• Collect More Platform Details #378

[stanbrub]

Did a demo of this here: https://youtu.be/fCspR8yViCk?si=sS1T5wIjdyYLzD90

[stanbrub]

Adhoc Dashboard is usable with this snippet.

from urllib.request import urlopen; import os

root = 'file:///nfs' if os.path.exists('/nfs/deephaven-benchmark') else 'https://storage.googleapis.com'
with urlopen(f'{root}/deephaven-benchmark/adhoc_dashboard.dh.py') as r:
    exec(r.read().decode(), globals(), locals())
    storage_uri = f'{root}/deephaven-benchmark'