Skip to content

v23.08.2

Compare
Choose a tag to compare
@github-actions github-actions released this 19 Oct 17:13

Packages

Changes

User Tools

  • Add unit tests for Dataproc GKE with mock GKE cluster (#618)
  • Add support in user tools for running qualification on Dataproc GKE (#612)
  • [BUG] Update user tools to use latest Databricks CLI version 0.200+ (#614)
  • Add argprocessor unit test for checking error messages for onprem with no eventlogs (#605)
  • Updating docs for custom speedup factors for scale factor (#604)
  • [FEA] Add qualification user tool options to support external pricing (#595)
  • [DOC] Add documentation for qualification user tool pricing discount options (#596)
  • [FEA] Add user qualification tool options for specifying pricing discounts for CPU or GPU cluster, or both (#583)
  • Add diagnostic capabilities for Databricks (AWS/Azure) environments (#533)
  • Add verbose option to the CLI (#550)
  • [FEA] Remove URLs from pydantic error messages (#560)
  • Rename and change pyrapids to spark_rapids_tools (#570)
  • Fix sdk_monitor exception thrown by abfs protocol (#569)

Core

  • Generating speedup factors for Dataproc GKE L4 GPU instances (#617)
  • Qualification tool: Add penalty for row conversions (#471)
  • Add support in core tools for running qualification on Dataproc GKE (#613)
  • Sync up remaining updated execs and exprs from rapids-plugin (#602)
  • Adding speedup factors for Dataproc Serverless and docs fix (#603)
  • Add xxhash64 function as supported in qualification tools (#597)
  • Fix ProjectExecParser to include digits in expression names (#592)
  • [FEA] Add json_tuple function as supported in qualification tool (#589)
  • [FEA] Add flatten function as supported in qualification tool (#587)
  • [FEA] Sync up conv function with rapids-plugin resources (#573)

Miscellaneous

  • Bump urllib3 from 1.26.17 to 1.26.18 in /data_validation (#622)
  • Bump urllib3 from 1.26.14 to 1.26.17 in /data_validation (#606)
  • Ignore pylint errors to fix python tests (#611)