Streaming Command Failed! in RHADOOP

前端 未结 2 846
滥情空心
滥情空心 2021-01-18 06:24

I have installed RHADOOP in Hortonwork VM. when I am running mapreduce code to verify it is throwing an error saying

I am using user as :rstudio (not root.but has

2条回答
  •  慢半拍i
    慢半拍i (楼主)
    2021-01-18 06:38

    Your current implmentation is using Rstudio. Can you try writing the code in .R and run using the hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-streaming.jar -input file-in-hadoop -output hdfs_output_dir -file mapper_file -file reducer_file -mapper mapper.R -reducer reducer.R

    By the way your exception PipeMapRed.waitOutputThreads(): can be caused only when there isn't proper input/output path specified. Please do check your paths.

    This should work.

提交回复
热议问题