Spark Scala Job is too slow to make an HTTP call with scalaj-http as UDF is slow

Question

I am trying to call an external API with a HTTP POST CALL. I am using the scalaj.http library. My input is a JSON file in AWS S3 and the output is KAFKA topic. Inbe