Use separate environ and sys.path between dags

Question

* TLDR: This question originally based on problem that was later determined to be due to the updated title of this question. Skip to \"Update 2\" for most r

Answer 1

For bringing in specific modules from other paths, I use the solution here to import other python modules by specifying their absolute file path.

For running various python scripts as airflow tasks using different python interpreters, I do something like...

do_stuff_a = BashOperator(
        task_id='my_task_a',
        bash_command='/path/to/virtualenv_a/bin/python /path/to/script_a.py'),
        execution_timeout=timedelta(minutes=30),
        dag=dag)

as done in similar question here