本页面列出了在 Managed Airflow 中已屏蔽或受限的 Airflow 配置选项。
Managed Airflow(第 3 代)中的配置选项有限
Managed Airflow(第 3 代)引入了有限的 Airflow 配置选项。这些选项的值只能在特定范围内。这些限制有助于确保某些 Airflow 配置不会对环境的运行或性能产生负面影响。
| 部分 | 配置选项 | 下限 | 最大值 |
|---|---|---|---|
core |
min_file_process_interval |
30 |
any |
core |
dag_file_processor_timeout |
any |
600 |
core |
dagbag_import_timeout |
dag_file_processor_timeout |
600 |
core |
dagbag_import_timeout |
dag_file_processor_timeout |
600 |
celery |
worker_concurrency |
1 |
24 |
kubernetes_executor |
worker_pods_queued_check_interval |
30 |
60 |
scheduler |
scheduler_heartbeat_sec |
15 |
any |
scheduler |
scheduler_health_check_threshold |
2 * scheduler_heartbeat_sec |
any |
triggerer |
triggerer_health_check_threshold |
30, or 2 * job_heartbeat_sec |
any |
triggerer |
job_heartbeat_sec |
30 |
any |
已屏蔽的配置选项
如果配置选项已屏蔽,则无法替换其值。
Airflow 3.1.8 中被屏蔽的配置
| Airflow 版本 | 部分 | 配置选项 | 备注 |
|---|---|---|---|
| 3.1.8 | cli |
所有配置选项 | |
| 3.1.8 | api_auth |
jwt_algorithm |
|
| 3.1.8 | api_auth |
jwt_audience |
|
| 3.1.8 | api_auth |
jwt_issuer |
|
| 3.1.8 | api_auth |
jwt_kid |
|
| 3.1.8 | api_auth |
jwt_private_key_path |
|
| 3.1.8 | api_auth |
jwt_secret |
|
| 3.1.8 | api_auth |
trusted_jwks_url |
|
| 3.1.8 | dag_processor |
dag_bundle_config_list |
|
| 3.1.8 | dag_processor |
dag_bundle_storage_path |
|
| 3.1.8 | execution_api |
jwt_audience |
|
| 3.1.8 | execution_api |
jwt_expiration_time |
|
| 3.1.8 | metrics |
statsd_ipv6 |
|
| 3.1.8 | kubernetes |
pod_template_file |
|
| 3.1.8 | kubernetes |
namespace |
|
| 3.1.8 | kubernetes |
api_client_retry_configuration |
|
| 3.1.8 | kubernetes |
cluster_context |
|
| 3.1.8 | kubernetes |
config_file |
|
| 3.1.8 | kubernetes |
delete_option_kwargs |
|
| 3.1.8 | kubernetes |
delete_worker_pods |
|
| 3.1.8 | kubernetes |
delete_worker_pods_on_failure |
|
| 3.1.8 | kubernetes |
enable_tcp_keepalive |
|
| 3.1.8 | kubernetes |
in_cluster |
|
| 3.1.8 | kubernetes |
kube_client_request_args |
|
| 3.1.8 | kubernetes |
logs_task_metadata |
|
| 3.1.8 | kubernetes |
multi_namespace_mode |
|
| 3.1.8 | kubernetes |
multi_namespace_mode_namespace_list |
|
| 3.1.8 | kubernetes |
ssl_ca_cert |
|
| 3.1.8 | kubernetes |
tcp_keep_cnt |
|
| 3.1.8 | kubernetes |
tcp_keep_idle |
|
| 3.1.8 | kubernetes |
tcp_keep_intvl |
|
| 3.1.8 | kubernetes |
verify_ssl |
|
| 3.1.8 | kubernetes_executor |
pod_template_file |
|
| 3.1.8 | kubernetes_executor |
namespace |
|
| 3.1.8 | kubernetes_executor |
api_client_retry_configuration |
|
| 3.1.8 | kubernetes_executor |
cluster_context |
|
| 3.1.8 | kubernetes_executor |
config_file |
|
| 3.1.8 | kubernetes_executor |
delete_option_kwargs |
|
| 3.1.8 | kubernetes_executor |
delete_worker_pods |
|
| 3.1.8 | kubernetes_executor |
delete_worker_pods_on_failure |
|
| 3.1.8 | kubernetes_executor |
enable_tcp_keepalive |
|
| 3.1.8 | kubernetes_executor |
in_cluster |
|
| 3.1.8 | kubernetes_executor |
kube_client_request_args |
|
| 3.1.8 | kubernetes_executor |
logs_task_metadata |
|
| 3.1.8 | kubernetes_executor |
multi_namespace_mode |
|
| 3.1.8 | kubernetes_executor |
multi_namespace_mode_namespace_list |
|
| 3.1.8 | kubernetes_executor |
ssl_ca_cert |
|
| 3.1.8 | kubernetes_executor |
tcp_keep_cnt |
|
| 3.1.8 | kubernetes_executor |
tcp_keep_idle |
|
| 3.1.8 | kubernetes_executor |
tcp_keep_intvl |
|
| 3.1.8 | kubernetes_executor |
verify_ssl |
|
| 3.1.8 | celery |
celery_app_name |
|
| 3.1.8 | celery |
worker_log_server_port |
|
| 3.1.8 | celery |
broker_url |
|
| 3.1.8 | celery |
result_backend |
|
| 3.1.8 | celery |
pool |
|
| 3.1.8 | celery |
worker_autoscale |
|
| 3.1.8 | celery |
default_queue |
|
| 3.1.8 | celery |
celery_config_options |
|
| 3.1.8 | celery |
flower_basic_auth |
|
| 3.1.8 | celery |
flower_host |
|
| 3.1.8 | celery |
flower_port |
|
| 3.1.8 | celery |
flower_url_prefix |
|
| 3.1.8 | celery |
result_backend_sqlalchemy_engine_options |
|
| 3.1.8 | celery |
ssl_active |
|
| 3.1.8 | celery |
ssl_cacert |
|
| 3.1.8 | celery |
ssl_cert |
|
| 3.1.8 | celery |
ssl_key |
|
| 3.1.8 | celery |
worker_enable_remote_control |
|
| 3.1.8 | celery |
worker_precheck |
|
| 3.1.8 | celery |
worker_prefetch_multiplier |
|
| 3.1.8 | operators |
default_queue |
|
| 3.1.8 | core |
dags_folder |
|
| 3.1.8 | core |
database_access_isolation |
|
| 3.1.8 | core |
execution_api_server_url |
|
| 3.1.8 | core |
fernet_key |
|
| 3.1.8 | core |
plugins_folder |
|
| 3.1.8 | core |
security |
|
| 3.1.8 | core |
sql_alchemy_conn |
|
| 3.1.8 | core |
sql_alchemy_pool_recycle |
|
| 3.1.8 | core |
sql_alchemy_pool_size |
|
| 3.1.8 | core |
load_examples |
|
| 3.1.8 | core |
store_serialized_dags |
|
| 3.1.8 | core |
store_dag_code |
|
| 3.1.8 | core |
wait_dag_not_found_timeout |
|
| 3.1.8 | core |
base_log_folder |
|
| 3.1.8 | core |
encrypt_s3_logs |
|
| 3.1.8 | core |
logging_config_class |
|
| 3.1.8 | core |
remote_base_log_folder |
|
| 3.1.8 | core |
remote_log_conn_id |
|
| 3.1.8 | core |
remote_logging |
|
| 3.1.8 | core |
task_log_reader |
|
| 3.1.8 | core |
log_format |
|
| 3.1.8 | core |
daemon_umask |
|
| 3.1.8 | core |
default_impersonation |
|
| 3.1.8 | core |
donot_pickle |
|
| 3.1.8 | core |
executor |
|
| 3.1.8 | core |
hostname_callable |
|
| 3.1.8 | core |
unit_test_mode |
|
| 3.1.8 | database |
sql_alchemy_conn |
|
| 3.1.8 | database |
sql_alchemy_pool_recycle |
|
| 3.1.8 | database |
sql_alchemy_pool_size |
|
| 3.1.8 | database |
alembic_ini_file_path |
|
| 3.1.8 | database |
external_db_managers |
|
| 3.1.8 | database |
migration_batch_size |
|
| 3.1.8 | smtp |
smtp_password |
|
| 3.1.8 | scheduler |
child_process_log_directory |
|
| 3.1.8 | scheduler |
enable_health_check |
|
| 3.1.8 | scheduler |
enable_tracemalloc |
|
| 3.1.8 | scheduler |
scheduler_health_check_server_port |
|
| 3.1.8 | scheduler |
standalone_dag_processor |
|
| 3.1.8 | scheduler |
parsing_processes |
|
| 3.1.8 | webserver |
access_logfile |
|
| 3.1.8 | webserver |
base_url |
|
| 3.1.8 | webserver |
error_logfile |
|
| 3.1.8 | webserver |
log_fetch_timeout_sec |
|
| 3.1.8 | webserver |
secret_key |
|
| 3.1.8 | webserver |
web_server_host |
|
| 3.1.8 | webserver |
web_server_port |
|
| 3.1.8 | webserver |
web_server_ssl_cert |
|
| 3.1.8 | webserver |
web_server_ssl_key |
|
| 3.1.8 | webserver |
web_server_worker_timeout |
|
| 3.1.8 | webserver |
worker_refresh_batch_size |
|
| 3.1.8 | logging |
base_log_folder |
|
| 3.1.8 | logging |
callsite_parameters |
|
| 3.1.8 | logging |
colored_console_log |
|
| 3.1.8 | logging |
dag_processor_manager_log_stdout |
|
| 3.1.8 | logging |
encrypt_s3_logs |
|
| 3.1.8 | logging |
log_format |
|
| 3.1.8 | logging |
logging_config_class |
|
| 3.1.8 | logging |
remote_base_log_folder |
|
| 3.1.8 | logging |
remote_log_conn_id |
|
| 3.1.8 | logging |
remote_logging |
|
| 3.1.8 | logging |
task_log_reader |
|
| 3.1.8 | api |
google_oauth2_audience |
|
| 3.1.8 | usage_data_collection |
enabled |
Airflow 3.1.7 中被屏蔽的配置
| Airflow 版本 | 部分 | 配置选项 | 备注 |
|---|---|---|---|
| 3.1.7 | cli |
所有配置选项 | |
| 3.1.7 | api_auth |
jwt_algorithm |
|
| 3.1.7 | api_auth |
jwt_audience |
|
| 3.1.7 | api_auth |
jwt_issuer |
|
| 3.1.7 | api_auth |
jwt_kid |
|
| 3.1.7 | api_auth |
jwt_private_key_path |
|
| 3.1.7 | api_auth |
jwt_secret |
|
| 3.1.7 | api_auth |
trusted_jwks_url |
|
| 3.1.7 | dag_processor |
dag_bundle_storage_path |
|
| 3.1.7 | dag_processor |
dag_bundle_config_list |
|
| 3.1.7 | execution_api |
jwt_audience |
|
| 3.1.7 | execution_api |
jwt_expiration_time |
|
| 3.1.7 | metrics |
statsd_ipv6 |
|
| 3.1.7 | kubernetes |
pod_template_file |
|
| 3.1.7 | kubernetes |
namespace |
|
| 3.1.7 | kubernetes |
api_client_retry_configuration |
|
| 3.1.7 | kubernetes |
cluster_context |
|
| 3.1.7 | kubernetes |
config_file |
|
| 3.1.7 | kubernetes |
delete_option_kwargs |
|
| 3.1.7 | kubernetes |
delete_worker_pods |
|
| 3.1.7 | kubernetes |
delete_worker_pods_on_failure |
|
| 3.1.7 | kubernetes |
enable_tcp_keepalive |
|
| 3.1.7 | kubernetes |
in_cluster |
|
| 3.1.7 | kubernetes |
kube_client_request_args |
|
| 3.1.7 | kubernetes |
logs_task_metadata |
|
| 3.1.7 | kubernetes |
multi_namespace_mode |
|
| 3.1.7 | kubernetes |
multi_namespace_mode_namespace_list |
|
| 3.1.7 | kubernetes |
ssl_ca_cert |
|
| 3.1.7 | kubernetes |
tcp_keep_cnt |
|
| 3.1.7 | kubernetes |
tcp_keep_idle |
|
| 3.1.7 | kubernetes |
tcp_keep_intvl |
|
| 3.1.7 | kubernetes |
verify_ssl |
|
| 3.1.7 | kubernetes_executor |
pod_template_file |
|
| 3.1.7 | kubernetes_executor |
namespace |
|
| 3.1.7 | kubernetes_executor |
api_client_retry_configuration |
|
| 3.1.7 | kubernetes_executor |
cluster_context |
|
| 3.1.7 | kubernetes_executor |
config_file |
|
| 3.1.7 | kubernetes_executor |
delete_option_kwargs |
|
| 3.1.7 | kubernetes_executor |
delete_worker_pods |
|
| 3.1.7 | kubernetes_executor |
delete_worker_pods_on_failure |
|
| 3.1.7 | kubernetes_executor |
enable_tcp_keepalive |
|