Using user defined function inside a spark rdd map operation in databricks

Question

I created a user defined function that takes filename as input, does regex operation and returns an ID

Now I have another dataframe(dfFileNames) which has filenames,