t4n1o edited a comment on issue #19192:
URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003782233


   Could it be the scheduler settings?:
   
   ```
   
   # [scheduler]
   airflow_scheduler_job_heartbeat_sec: 5
   airflow_scheduler_clean_tis_without_dagrun_interval: 15.0
   airflow_scheduler_heartbeat_sec: 5
   airflow_scheduler_num_runs: -1
   airflow_scheduler_processor_poll_interval: 1
   airflow_scheduler_min_file_process_interval: 30
   # 
https://stackoverflow.com/questions/43606311/refreshing-dags-without-web-server-restart-apache-airflow
   airflow_scheduler_dag_dir_list_interval: 40 # How often to check dag folder 
for new dags
   airflow_scheduler_print_stats_interval: 30
   airflow_scheduler_pool_metrics_interval: 5.0
   airflow_scheduler_scheduler_health_check_threshold: 30
   airflow_scheduler_orphaned_tasks_check_interval: 300.0
   airflow_child_process_log_folder: "{{ airflow_logs_folder }}/scheduler"
   airflow_scheduler_zombie_task_threshold: 300
   airflow_scheduler_catchup_by_default: True
   airflow_scheduler_max_tis_per_query: 512
   airflow_scheduler_use_row_level_locking: True
   airflow_scheduler_max_dagruns_to_create_per_loop: 10
   airflow_scheduler_max_dagruns_per_loop_to_schedule: 20
   airflow_scheduler_schedule_after_task_execution: True
   airflow_scheduler_parsing_processes: 2
   airflow_file_parsing_sort_mode: modified_time
   airflow_scheduler_use_job_schedule: True
   airflow_scheduler_allow_trigger_in_future: False
   airflow_dependency_detector: 
"airflow.serialization.serialized_objects.DependencyDetector"
   
   airflow_scheduler_run_duration: -1
   airflow_scheduler_min_file_parsing_loop_time: 1
   airflow_scheduler_max_threads: 2
   airflow_scheduler_authenticate: True
   
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to