java.io.IOException: Cannot run program “python”: CreateProcess error=2, The system cannot find the file specified

不打扰是莪最后的温柔 提交于 2020-01-06 08:23:56

问题


I configured eclipse with pyspark

i am using latest version of SPARK and PYTHON.

when i try to code something and run. i get below error.

java.io.IOException: Cannot run program "python": CreateProcess error=2, The system cannot find the file specified

code i have written is below

'''
Created on 23-Dec-2017

@author: lenovo
'''
from pyspark import SparkContext,SparkConf

from builtins import int

#from org.spark.com.PySparkDemo import data

from pyspark.sql import Row

from pyspark.sql.context import SQLContext



conf = SparkConf().setAppName("FileSystem").setMaster("local")

sc=SparkContext(conf=conf)

sqlContext=SQLContext(sc)

a = sc.textFile("C:/Users/lenovo/Desktop/file.txt")

b = a.map(lambda x:x.split(",")).map(lambda x:Row(id=int(x[0]),name=x[1],marks=int(x[2])))

c = sqlContext.createDataFrame(b)

c.show()

please suggest


回答1:


Assuming you have installed pydev

under Windows > preferences > Pydev > interpreters > python interpreters > go to environment

under environment you need to give path of pyhton.exe file, Variable name as PYSPARK_PYTHON



来源:https://stackoverflow.com/questions/47952935/java-io-ioexception-cannot-run-program-python-createprocess-error-2-the-sys

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!