Apache Airflow version

Other Airflow 2 version (please specify below)

If "Other Airflow 2 version" selected, which one?

Airflow 3.0.0

What happened?

Environment:
Airflow Version: 3.0.0
Executor: LocalExecutor
Database Backend: MySQL
Python Version: 3.12
OS: Ubuntu 22.04
Deployment Method: VM

Summary:
1. After upgrading to Airflow 3.0.0, a specific task inside multiple DAGs starts failing every 2–3 days.
2. DAG runs successfully, but the same task fails with the same error repeatedly.
3. Restarting Airflow services temporarily resolves the task failure.
4. No code change, no DAG change, no environment change between working and failing runs.

🧾 Error Message:

The error occurs for the entire DAG as well as for a specific task, as shown in the image below. While the DAG appears to execute successfully, the task fails with the same recurring error. PFA screenshots and error messages below:

Log message source details: sources=["Could not read served logs: Invalid URL 'http://:8793/log/dag_id=BataApac_Fraud_Service/run_id=scheduled__2025-06-08T05:20:00+00:00/task_id=fraud_service/attempt=1.log': No host supplied"] ::group::Log message source details: sources=["Could not read served logs: Invalid URL 'http://:8793/log/dag_id=BataApac_Fraud_Service/run_id=scheduled__2[0](http://host:8081/dags/BataApac_Fraud_Service/runs/scheduled__2025-06-08T05:20:00+00:00/tasks/fraud_service?try_number=1#0)25-06-08T05:20:00+00:00/task_id=fraud_service/attempt=1.log': No host supplied"]

📌 Temporary Workaround

1. Restarting the Airflow services manually resolves the issue temporarily.
2. After restart, DAGs resume normal execution without changes.

🔧 Suggestions Needed

1. Any known issue related to DAG failure loop in 3.0.0?
2. Recommended fix or workaround?
3. Should we downgrade or patch?

What you think should happen instead?

No response

How to reproduce

I’m currently unable to provide a specific reproducible case, as the issue occurs intermittently. However, here’s the behavior I’ve observed:

After upgrading to Airflow 3.0.0, everything works fine for 2–3 days.

Suddenly, some DAGs or specific tasks fail with log URL issues (No host supplied or invalid log path).

The DAG run may complete, but a few tasks still fail and show no logs due to malformed log URLs (e.g., http://:8793/...).

Restarting the Airflow services resolves the issue temporarily, and all DAGs and tasks resume normal execution.

This seems to be related to Airflow’s logging system or task instance state management. Let me know if there’s a way I can collect more debug logs or configuration snapshots to help troubleshoot.

Operating System

ubuntu 22.04

Versions of Apache Airflow Providers

Providers info
apache-airflow-providers-airbyte | 5.0.2
apache-airflow-providers-alibaba | 3.0.3
apache-airflow-providers-amazon | 9.6.1
apache-airflow-providers-apache-beam | 6.0.4
apache-airflow-providers-apache-cassandra | 3.7.2
apache-airflow-providers-apache-drill | 3.0.1
apache-airflow-providers-apache-druid | 4.1.1
apache-airflow-providers-apache-flink | 1.6.2
apache-airflow-providers-apache-hdfs | 4.8.1
apache-airflow-providers-apache-hive | 9.0.6
apache-airflow-providers-apache-iceberg | 1.2.1
apache-airflow-providers-apache-impala | 1.6.1
apache-airflow-providers-apache-kafka | 1.8.1
apache-airflow-providers-apache-kylin | 3.8.3
apache-airflow-providers-apache-livy | 4.3.2
apache-airflow-providers-apache-pig | 4.6.1
apache-airflow-providers-apache-pinot | 4.7.0
apache-airflow-providers-apache-spark | 5.2.1
apache-airflow-providers-apprise | 2.0.2
apache-airflow-providers-arangodb | 2.7.4
apache-airflow-providers-asana | 2.9.1
apache-airflow-providers-atlassian-jira | 3.0.2
apache-airflow-providers-celery | 3.10.6
apache-airflow-providers-cloudant | 4.1.1
apache-airflow-providers-cncf-kubernetes | 10.4.3
apache-airflow-providers-cohere | 1.4.3
apache-airflow-providers-common-compat | 1.6.0
apache-airflow-providers-common-io | 1.5.4
apache-airflow-providers-common-messaging | 1.0.0
apache-airflow-providers-common-sql | 1.26.0
apache-airflow-providers-databricks | 7.3.2
apache-airflow-providers-datadog | 3.8.3
apache-airflow-providers-dbt-cloud | 4.3.3
apache-airflow-providers-dingding | 3.7.3
apache-airflow-providers-discord | 3.9.5
apache-airflow-providers-docker | 4.3.1
apache-airflow-providers-edge3 | 1.0.0
apache-airflow-providers-elasticsearch | 6.2.2
apache-airflow-providers-exasol | 4.7.5
apache-airflow-providers-fab | 2.0.1
apache-airflow-providers-facebook | 3.7.2
apache-airflow-providers-ftp | 3.12.3
apache-airflow-providers-git | 0.0.2
apache-airflow-providers-github | 2.8.3
apache-airflow-providers-google | 15.1.0
apache-airflow-providers-grpc | 3.7.3
apache-airflow-providers-hashicorp | 4.1.1
apache-airflow-providers-http | 5.2.2
apache-airflow-providers-imap | 3.8.3
apache-airflow-providers-influxdb | 2.8.3
apache-airflow-providers-jdbc | 5.1.0
apache-airflow-providers-jenkins | 4.0.4
apache-airflow-providers-microsoft-azure | 12.3.1
apache-airflow-providers-microsoft-mssql | 4.2.2
apache-airflow-providers-microsoft-psrp | 3.0.1
apache-airflow-providers-microsoft-winrm | 3.9.2
apache-airflow-providers-mongo | 5.0.3
apache-airflow-providers-mysql | 4.0.2
apache-airflow-providers-neo4j | 3.8.2
apache-airflow-providers-odbc | 4.9.2
apache-airflow-providers-openai | 1.5.4
apache-airflow-providers-openfaas | 3.7.2
apache-airflow-providers-openlineage | 2.2.0
apache-airflow-providers-opensearch | 1.6.3
apache-airflow-providers-opsgenie | 5.8.3
apache-airflow-providers-oracle | 4.0.3
apache-airflow-providers-pagerduty | 4.0.3
apache-airflow-providers-papermill | 3.10.1
apache-airflow-providers-pgvector | 1.4.1
apache-airflow-providers-pinecone | 2.2.2
apache-airflow-providers-postgres | 6.1.3
apache-airflow-providers-presto | 5.8.4
apache-airflow-providers-qdrant | 1.3.2
apache-airflow-providers-redis | 4.0.2
apache-airflow-providers-salesforce | 5.10.1
apache-airflow-providers-samba | 4.9.2
apache-airflow-providers-segment | 3.7.2
apache-airflow-providers-sftp | 5.2.1
apache-airflow-providers-singularity | 3.7.1
apache-airflow-providers-slack | 9.0.5
apache-airflow-providers-smtp | 2.0.3
apache-airflow-providers-snowflake | 6.2.2
apache-airflow-providers-sqlite | 4.0.2
apache-airflow-providers-ssh | 4.0.1
apache-airflow-providers-standard | 1.0.0
apache-airflow-providers-tableau | 5.0.2
apache-airflow-providers-telegram | 4.7.2
apache-airflow-providers-teradata | 3.0.3
apache-airflow-providers-trino | 6.1.2
apache-airflow-providers-vertica | 4.0.1
apache-airflow-providers-weaviate | 3.0.3
apache-airflow-providers-yandex | 4.0.3
apache-airflow-providers-ydb | 2.1.1
apache-airflow-providers-zendesk | 4.9.1

Deployment

Official Apache Airflow Helm Chart

Deployment details

Airflow Version: 3.0.0
Executor: LocalExecutor
Database Backend: MySQL v8
Python Version: 3.12
OS: Ubuntu 22.04
Deployment Method: VM

Anything else?

1. No changes are made in DAGs or dependencies in this period.
2. Happens on both new and existing DAGs.
3. Could potentially be memory/resource exhaustion or zombie DAG issue.

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct