Getting cascading.tap.hadoop.io.MultiInputSplit class not found exception while running hadoop program using cascading framework

后端 未结 2 354
谎友^
谎友^ 2021-01-17 01:59

Here is my code that connects to hadoop machine and perform set of validation and write on another directory.

      public class Main{

            public s         


        
相关标签:
2条回答
  • 2021-01-17 02:21

    Your Properties file is empty so it may be that your configuration for this job is off on the cluster. You must provide the configuration that you are using to HadoopFlowController. The information contained in your Hadoop Configuration files found when you call new Configuration belongs within your Properties object -things like fs.default.name=file://// etc. I imagine this is even more so the case when you are running a Cascading job across the "wire".

    0 讨论(0)
  • 2021-01-17 02:26

    got the issue. CDH 4.2 has issue with cascading 2.1. So changed to CDH 4.1 and it worked for me.

    0 讨论(0)
提交回复
热议问题