Pyspark: \Anaconda3\envs\xgboost\python.exe] was unexpected at this time

Question

I am trying to install Pyspark in Windows.

I applied setx to the following:

PYSPARK_DRIVER_PYTHON \"C:\\Users\\Sade D\\Anaconda3\\envs\\xgboost\\Scripts         


        

Answer 1

It looks like you are having issues with spaces in folder names, in particular the space in C:\Users\Sade D, where you appear to have installed Anaconda.

Try uninstalling Anaconda and reinstalling it in a folder without any spaces. The video uses C:\ProgramData\Anaconda3 (you can see this at 5:34): try installing into that folder instead of C:\Users\Sade D.