Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UOL's DiRAC apps minor update... #234

Merged
merged 2 commits into from
Nov 20, 2023
Merged

UOL's DiRAC apps minor update... #234

merged 2 commits into from
Nov 20, 2023

Conversation

asifsamiarain
Copy link
Collaborator

`+ python excalibur-tests/post-processing/post_processing.py perflogs ppp_config.yaml -d -v
Found log files:

  • perflogs/dial3/compute-node/Sphng_Strong_Scaling_evolution.log
  • perflogs/dial3/compute-node/Osu_allreduce.log
  • perflogs/dial3/compute-node/Osu_bibw.log
  • perflogs/dial3/compute-node/TROVE_14N.log
  • perflogs/dial3/compute-node/TROVE_12N.log
  • perflogs/dial3/compute-node/Osu_bw.log
  • perflogs/dial3/compute-node/Sphng_Weak_Scaling_evolution.log
  • perflogs/dial3/compute-node/Osu_latency.log
  • perflogs/dial3/compute-node/RamsesMPI_weak.log
  • perflogs/dial3/compute-node/Osu_allgather.log
  • perflogs/dial3/compute-node/TROVE_16N.log
  • perflogs/dial3/compute-node/RamsesMPI_strong.log
  • perflogs/dial3/compute-node/PdsyevSingle.log
  • perflogs/dial3/compute-node/Osu_alltoall.log
  • perflogs/dial3/compute-node/Sphng_Single_Node_evolution.log

Discarding Sphng_Strong_Scaling_evolution.log: KeyError: Perflog missing one or more required fields ['job_completion_time', '\w+_value$', '\w+_unit$', 'display_name']

Discarding TROVE_14N.log: KeyError: Perflog missing one or more required fields ['job_completion_time', '\w+_value$', '\w+_unit$', 'display_name']

Discarding TROVE_12N.log: KeyError: Perflog missing one or more required fields ['job_completion_time', '\w+_value$', '\w+_unit$', 'display_name']

Discarding Sphng_Weak_Scaling_evolution.log: KeyError: Perflog missing one or more required fields ['job_completion_time', '\w+_value$', '\w+_unit$', 'display_name']

Discarding RamsesMPI_weak.log: KeyError: Perflog missing one or more required fields ['job_completion_time', '\w+_value$', '\w+_unit$', 'display_name']

Discarding TROVE_16N.log: KeyError: Perflog missing one or more required fields ['job_completion_time', '\w+_value$', '\w+_unit$', 'display_name']

Discarding RamsesMPI_strong.log: KeyError: Perflog missing one or more required fields ['job_completion_time', '\w+_value$', '\w+_unit$', 'display_name']

Discarding Sphng_Single_Node_evolution.log: KeyError: Perflog missing one or more required fields ['job_completion_time', '\w+_value$', '\w+_unit$', 'display_name']

KeyError: ('Could not find columns', ['Total elapsed time_value'])
Post-processing stopped`

Copy link
Member

@giordano giordano left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Out of curiosity, was this a problem with spaces in the key name?

@asifsamiarain
Copy link
Collaborator Author

That's what my impression is, "spaces in the key name" seems problematic.

@asifsamiarain asifsamiarain merged commit fa2510e into main Nov 20, 2023
4 checks passed
@asifsamiarain asifsamiarain deleted the ma_uol_dirac_ppp_aid branch November 20, 2023 13:04
@mirenradia
Copy link
Contributor

I think this change has broken things for me (at least for the ramses benchmark). I presume the intention was to change the perf_keys but I think the pattern matches should be the old ones.

@asifsamiarain asifsamiarain restored the ma_uol_dirac_ppp_aid branch November 24, 2023 10:19
@asifsamiarain
Copy link
Collaborator Author

Thanks for testing @mirenradia seems like a typo, I will test and get this fixed in next merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants