Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DEVPROD-14170 Add additional logging for long running task generation #87

Merged
merged 2 commits into from
Jan 21, 2025

Conversation

sleaux
Copy link
Collaborator

@sleaux sleaux commented Jan 16, 2025

No description provided.

@sleaux
Copy link
Collaborator Author

sleaux commented Jan 16, 2025

This logging is in support of tracking down a rare hang seen in https://jira.mongodb.org/browse/BF-35879.

The remaining task count may support one of two suspicions:

  1. If only a single task is left remaining at the hang, it is likely hung on an query to an external resource. I think this is unlikely since the web requests already timeout+retry and in the system logs from the timed-out task there are no resmoke.py process lingering around.
  2. If there are 2+ tasks left remaining, it's possible they are deadlocked on each other, and we can chase down that further.

Patch build in mongodb-mongo-master using a mongo-task-generator built from this branch: https://spruce.mongodb.com/version/678954a36e87f90007f3969a (lint failures not relevant)

@sleaux sleaux requested a review from a team January 16, 2025 20:19
@sleaux sleaux marked this pull request as ready for review January 16, 2025 20:19
Copy link
Collaborator

@MikhailShchatko MikhailShchatko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice use of tokio lib, good job!

@sleaux sleaux added this pull request to the merge queue Jan 21, 2025
Merged via the queue into master with commit be6ad1d Jan 21, 2025
2 checks passed
@sleaux sleaux deleted the sleaux/DEVPROD-14170_0 branch January 21, 2025 14:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants