Memory leaks when using pandas_udf and Parquet serialization?

Question

I am currently developing my first whole system using PySpark and I am running into some strange, memory-related issues. In one of the stages, I would like to resemble a Split-A