I have an Airflow pipeline, and one of the DAGs contains a Spark job. I have two options for the Spark job (the job writes to ElasticSearch, but I don\'t know if this is use