OOMKilled error in pyspark driver when trying to read request content python

Question

I want to write huge data(around 1GB) to S3 after getting particular content of request through Beautiful Soup. Getting OOMKilled when trying to perform the operation for la