Skip to content

Commit

Permalink
Adjust airflow parameters
Browse files Browse the repository at this point in the history
Detect and reschedule tasks faster
  • Loading branch information
ranlu committed Sep 11, 2024
1 parent 4f23c8b commit 494f0d5
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions config/airflow.cfg
Original file line number Diff line number Diff line change
Expand Up @@ -459,14 +459,14 @@ print_stats_interval = 300
child_process_log_directory = /usr/local/airflow/logs/scheduler

# How often (in seconds) should the scheduler check for orphaned tasks and SchedulerJobs
orphaned_tasks_check_interval = 600.0
orphaned_tasks_check_interval = 300.0

# Local task jobs periodically heartbeat to the DB. If the job has
# not heartbeat in this many seconds, the scheduler will mark the
# associated task instance as failed and will re-schedule the task.
scheduler_zombie_task_threshold = 900
scheduler_zombie_task_threshold = 120

zombie_detection_interval = 180.0
zombie_detection_interval = 60.0

# Turn off scheduler catchup by setting this to False.
# Default behavior is unchanged and
Expand Down

0 comments on commit 494f0d5

Please sign in to comment.