I have a series of Spark jobs, all scheduled through OOZIE on Yarn (HDP). My Big data stack is HDFS, Spark, OOZIE. The spark jars after building through sbt are uploaded to HDFS