I use hadoop 2.10.x + hive 3.1.x + spark 3.0.1 and try to load log file into hive by pyspark. i follow the code from spark document to connect to hive.
warehouse_