问题
i am running the airflow pipeline but codes looks seems good but actually i'm getting the airflow.exceptions.AirflowException: Cycle detected in DAG. Faulty task: can u please help to resolve this issue
回答1:
This can happen due to duplicate task_id'a in multiple tasks.
回答2:
Without the code, it's kind of hard to help you. However, this means that you have a loop in your DAG. Generally, thie error happens when one of your task has a downstream task whose own downstream chain includes it again (A calls B calls C calls D calls A again, for example). That's not permitted by Airflow (and DAGs in general).
回答3:
Airflow pipeline is based on DAGs(Directed Acyclic Graph) which means in the pipeline there can be no loops or cycles.
Arrange your pipeline in a way that there are no cycles. One downstream task shouldn't be calling any of its own upstream tasks.
来源:https://stackoverflow.com/questions/45731858/airflow-exceptions-airflowexception-cycle-detected-in-dag-faulty-task