Unable to write (py)spark dataframe to redshift using jdbc driver

Question

I could successfully connect from my Jupyter Notebook to Redshift via the following

import findspark
findspark.init()
import pyspark
from pyspark import Spark