Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loading Incomplete Cache After Benchmark Preprocessing Failure #11

Open
zhizhou57 opened this issue Feb 10, 2025 · 0 comments
Open

Loading Incomplete Cache After Benchmark Preprocessing Failure #11

zhizhou57 opened this issue Feb 10, 2025 · 0 comments

Comments

@zhizhou57
Copy link
Collaborator

If a benchmark task fails during preprocessing, flagevalmm saves incomplete cache data. When rerunning the task, it reads from this corrupted cache, causing repeated failures.

Steps to Reproduce:
1. Run a benchmark task that fails during preprocessing. (Such as using ctrl+c)
2. Re-run the same task.
3. It fails due to reading incomplete cached data.

Expected Behavior:
• Detect and remove corrupted cache files.
• Provide an option to force re-preprocessing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant