airflow.exceptions.AirflowException: Cycle detected in DAG. Faulty task

别等时光非礼了梦想. 提交于 2019-12-24 07:46:52

问题


i am running the airflow pipeline but codes looks seems good but actually i'm getting the airflow.exceptions.AirflowException: Cycle detected in DAG. Faulty task: can u please help to resolve this issue


回答1:


This can happen due to duplicate task_id'a in multiple tasks.




回答2:


Without the code, it's kind of hard to help you. However, this means that you have a loop in your DAG. Generally, thie error happens when one of your task has a downstream task whose own downstream chain includes it again (A calls B calls C calls D calls A again, for example). That's not permitted by Airflow (and DAGs in general).




回答3:


Airflow pipeline is based on DAGs(Directed Acyclic Graph) which means in the pipeline there can be no loops or cycles.

Arrange your pipeline in a way that there are no cycles. One downstream task shouldn't be calling any of its own upstream tasks.



来源:https://stackoverflow.com/questions/45731858/airflow-exceptions-airflowexception-cycle-detected-in-dag-faulty-task

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!