Unable to use an existing Hive permanent UDF from Spark SQL

Question

I have previously registered a UDF with hive. It is permanent not TEMPORARY. It works in beeline.

CREATE FUNCTION normaliseURL AS \'com.example.hive         


        

Answer 1

It will work on spark on yarn environment however as suggested you need to use spark-shell --jars .jar not in hdfs but in local.