I\'m new to spark, we are doing all hive statements in spark Data Frame, We can use spark.sql running the whole sql statements, but we need to use spark transformations
<