Skip to content

Commit

Permalink
Revert "Enable event log for qualification & profiling tools testing … (
Browse files Browse the repository at this point in the history
NVIDIA#12103)

This reverts NVIDIA#4217 commit b18492e.

NVIDIA#4217 was turning on event logging which was already on by default.
NVIDIA#4217 overrode xdist-aware setting of event log locations, and causes
the hang

Fixes NVIDIA#12096 

Downstream steps in pipelines need to collect event logs under all
eventlog_gw[0-9] paths

```
$ find ./integration_tests/target/run_dir-20250211100159-C4VO -name \*zstd
./integration_tests/target/run_dir-20250211100159-C4VO/eventlog_gw3/eventlog_v2_local-1739268134946/events_1_local-1739268134946.zstd
./integration_tests/target/run_dir-20250211100159-C4VO/eventlog_gw0/eventlog_v2_local-1739268134579/events_1_local-1739268134579.zstd
./integration_tests/target/run_dir-20250211100159-C4VO/eventlog_gw2/eventlog_v2_local-1739268134806/events_1_local-1739268134806.zstd
./integration_tests/target/run_dir-20250211100159-C4VO/eventlog_gw1/eventlog_v2_local-1739268134420/events_1_local-1739268134420.zstd
```

---------

Signed-off-by: Gera Shegalov <[email protected]>
  • Loading branch information
gerashegalov authored Feb 11, 2025
1 parent 5d8ab9d commit 2cc2992
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions jenkins/databricks/test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -74,10 +74,6 @@ IS_SPARK_321_OR_LATER=0
# --packages in distributed setups, should be fixed by
# https://github.com/NVIDIA/spark-rapids/pull/5646

# Enable event log for qualification & profiling tools testing
export PYSP_TEST_spark_eventLog_enabled=true
mkdir -p /tmp/spark-events

export PYSP_TEST_spark_rapids_shims_spark350db143_enabled=${PYSP_TEST_spark_rapids_shims_spark350db143_enabled:-true}

rapids_shuffle_smoke_test() {
Expand Down

0 comments on commit 2cc2992

Please sign in to comment.