Debugging Broken DAGs

Question

When the airflow webserver shows up errors like Broken DAG: [] , how and where can we find the full stacktrace for these excepti

Answer 1

What you want to do is access the inner logs of the webserver so that you get the full stacktrace. My Airflow server is being executed in a Docker image so I'll use Docker to fetch these logs but the idea remains.

1. docker ps
2. fetch the PID of the webserver
3. docker logs [PID]
4. read the full logs of the given Airflow webserver.

This should contain the exact information of why your DAG build failed.