Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add backoff strategy for job polling #165

Merged
merged 1 commit into from
Jan 2, 2024
Merged

add backoff strategy for job polling #165

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions babs/babs.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -913,11 +913,10 @@ def babs_check_setup(self, input_ds, flag_job_test):
# check job status every 1 min:
flag_done = False # whether job is out of queue (True)
flag_success_test_job = False # whether job was successfully finished (True)
print("Will check the test job's status every 1 min...")
print("Will check the test job's status using backoff strategy")
sleeptime = 1
while not flag_done:
# wait for 1 min:
time.sleep(60) # Sleep for 60 seconds

time.sleep(sleeptime)
# check the job status
df_all_job_status = request_all_job_status(self.type_system)
d_now_str = str(datetime.now())
Expand All @@ -936,6 +935,8 @@ def babs_check_setup(self, input_ds, flag_job_test):
to_print += "Test job is pending (`qw`)..."
elif state_code == "eqw":
to_print += "Test job is stalled (`eqw`)..."
sleeptime = sleeptime * 2
print(f"Waiting {sleeptime} seconds before retry")

else: # the job is not in queue:
flag_done = True
Expand Down
Loading