Code

First benchmarks for kmeans#1

Code

Merged

fcharras merged 37 commits intomainsoda-inria/sklearn-engine-benchmarks:mainfrom first_kmeans_benchmarkssoda-inria/sklearn-engine-benchmarks:first_kmeans_benchmarksCopy head branch name to clipboardOct 11, 2023

+1,956-145

Commits

Commits on Sep 12, 2023

• Add kmeans solvers for scikit-learn, sklearn_numba_dpex, sklearn_pytorch_engine and scikit-learn-intelex

  fcharras

  committed
  27bd685

  Copy full SHA for 27bd685

Commits on Sep 13, 2023

• Use scikit-learn-intelex interface rather than digging internals for direct daal4py calls

  fcharras

  committed
  0698c7f

  Copy full SHA for 0698c7f

• add cuml solver

  fcharras

  committed
  a345b04

  Copy full SHA for a345b04

• Add kmeans_dpcpp solver

  fcharras

  committed
  9eac893

  Copy full SHA for 9eac893

Commits on Sep 14, 2023

• Add CI run for kmeans cpu benchmarks for sklearn numba dpex

  fcharras

  committed
  2fabb18

  Copy full SHA for 2fabb18

• Run all backends compatible with CPU in CI

  fcharras

  committed
  5d9c3a0

  Copy full SHA for 5d9c3a0

Commits on Sep 15, 2023

• have return all parameters for all runs in a dict for a better browsable structure of the output parquet table

  fcharras

  committed
  b19f2ae

  Copy full SHA for b19f2ae

• Expose more strutured metadata in the parquet table, + parquet cleaning script draft for kmeans.

  fcharras

  committed
  6f9622b

  Copy full SHA for 6f9622b

Commits on Sep 17, 2023

• Expose a command to maintain the csv database of benchmark results in the repo

  fcharras

  committed
  ed66d5a

  Copy full SHA for ed66d5a

Commits on Sep 18, 2023

• Command that run a few test on the CSV result file for k-means + run in CI on file changes.

  fcharras

  committed
  3b7573c

  Copy full SHA for 3b7573c

Commits on Sep 19, 2023

• Command that synchronizes the k-means benchmark results to a public google spreadsheet + sync automation when results are commited on main branch

  fcharras

  committed
  db13781

  Copy full SHA for db13781

• Reorder columns

  fcharras

  committed
  20d43d9

  Copy full SHA for 20d43d9

• Add README

  fcharras

  committed
  5aefd7c

  Copy full SHA for 5aefd7c

• More information in README

  fcharras

  committed
  945ecd2

  Copy full SHA for 945ecd2

• Add missing columns in the database of results, including a gpu name column with dedicated command parameter to manage the list of known gpu names

  fcharras

  committed
  07fce26

  Copy full SHA for 07fce26

• Update result.csv for kmeans

  fcharras

  committed
  5ee2c73

  Copy full SHA for 5ee2c73

Commits on Sep 20, 2023

• Initiate result csv with real data + minor tweaks

  fcharras

  committed
  ee02e86

  Copy full SHA for ee02e86

• Remove minimum benchopt version requirement

  ogrisel

  committed
  159bbbd

  Copy full SHA for 159bbbd

• Consolidate Apple M1 results for the small dataset kmeans benchmark

  ogrisel

  committed
  b8493d0

  Copy full SHA for b8493d0

• Add the raw benchopt output for the Apple M1 run

  ogrisel

  committed
  13064b1

  Copy full SHA for 13064b1

• Update csv results with appropriate n cpus fixed to 32 with taskset

  fcharras

  committed
  7a7dbfc

  Copy full SHA for 7a7dbfc

• Consolidate Apple M1 and sklearn-numba-dpex CPU on IDC

  fcharras

  committed
  4369b2f

  Copy full SHA for 4369b2f

Commits on Sep 21, 2023

• Consolidate IDC results on 10000000 samples

  fcharras

  committed
  937ba81

  Copy full SHA for 937ba81

• Fix a bug were some benchopt parquet files could duplicate rows in the consolidated files because of missing values and update consolidated csv accordingly

  fcharras

  committed
  b24fbb2

  Copy full SHA for b24fbb2

• Add IDC results on 50_000_000 samples

  fcharras

  committed
  646086f

  Copy full SHA for 646086f

• Revert license change

  fcharras

  committed
  15635ba

  Copy full SHA for 15635ba

• Fix date format issues in consolidation script / add some cuda benchmarks

  fcharras

  committed
  5fb36d5

  Copy full SHA for 5fb36d5

Commits on Oct 6, 2023

• Add version information to solver metadata

  fcharras

  committed
  b6fae1b

  Copy full SHA for b6fae1b

Commits on Oct 7, 2023

• Bump versions, install benchopt from pypi rather than build from source

  fcharras

  committed
  24bf8c0

  Copy full SHA for 24bf8c0

Commits on Oct 10, 2023

• WIP: add PCA

  fcharras

  committed
  dd5c0fe

  Copy full SHA for dd5c0fe

• remove uninteresting parameter combinations for benchmarks for kmeans and pca - fix pca tests

  fcharras

  committed
  1ed7c27

  Copy full SHA for 1ed7c27

Commits on Oct 11, 2023

• Add consolidate result script for PCA

  fcharras

  committed
  ad2c2ca

  Copy full SHA for ad2c2ca

• List PCA benchmark in README section

  fcharras

  committed
  e897181

  Copy full SHA for e897181

• Adress a few remaining comments, add links to benchopt howtos in the README

  fcharras

  committed
  36eae32

  Copy full SHA for 36eae32

• Fix sanity check workflow yaml

  fcharras

  committed
  b748755

  Copy full SHA for b748755

• Upload clean results

  fcharras

  committed
  c8ea93e

  Copy full SHA for c8ea93e

• Remove PCA additions before first merge for KMeans

  fcharras

  committed
  dd80dab

  Copy full SHA for dd80dab