where is hadoop-test.jar in Hadoop2?

给你一囗甜甜゛ 提交于 2019-12-13 05:17:26

问题


I want to use testmapredsort for benchmarking sort in Hadoop. I am NOT using TeraSort now.

hadoop-*test*.jar is supposed to contain the testmapredsort class. But I do not see hadoop-*test*.jar in Hadoop2.

hadoop jar hadoop/share/hadoop/common/hadoop-common-2.2.0-tests.jar testmapredsort /data/unsorted-data -sortOutput /data/sorted-data

回答1:


In Hadoop 1, testmapredsort is launched from AllTestDriver.java, which was indeed in e.g. hadoop-test-1.2.1.jar. In Hadoop 2, it's now in MapredTestDriver.java, which can be found inside of hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar

hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar testmapredsort -sortInput /data/unsorted-data -sortOutput /data/sorted-data


来源:https://stackoverflow.com/questions/25317907/where-is-hadoop-test-jar-in-hadoop2

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!