一.环境准备:
1.VirtualBox虚拟机:
VirtualBox-4.2.8-83876-Win.exe
1)安装扩展:
Oracle_VM_VirtualBox_Extension_Pack-4.2.8-83876.vbox-extpack
2)开启网络(必需连接到互联网):
3)安装Ubuntu:
ubuntu-10.04-desktop-i386.iso
(1)安装:
(2)启用粘贴板共享和拖放支持:
(3)安装增强功能:
(4)初始化root用户:
sudo passwd root
2.安装jdk,配置环境变量:
jdk-6u24-linux-i586.bin
sudo chmod u+x jdk-6u24-linux-i586.bin
sudo -s ./jdk-6u24-linux-i586.bin
sudo gedit /etc/profile
export JAVA_HOME=%JDK%
export CLASSPATH=$JAVA_HOME/lib
export PATH=$JAVA_HOME/bin:$PATH
source /etc/profile
或 jdk-7u17-linux-i586.tar.gz ( 本例使用 )
sudo tar -xzvf jdk-7u17-linux-i586.tar.gz
sudo gedit /etc/profile
export JAVA_HOME=%JDK%
export CLASSPATH=$JAVA_HOME/lib
export PATH=$JAVA_HOME/bin:$PATH
source /etc/profile
3.安装ant:
m4-1.4.16.tar.gz
autoconf-2.65.tar.gz
automake-1.13.tar.gz
libtool-2.4.tar.gz
apache-ant-1.9.0-bin.tar.gz
autoconf-2.65.tar.gz
automake-1.13.tar.gz
libtool-2.4.tar.gz
apache-ant-1.9.0-bin.tar.gz
1)安装m4:
sudo tar -zxvf m4-1.4.16.tar.gz
cd m4-1.4.16
sudo ./configure --prefix=/usr/local
sudo make
sudo make install
2)安装autoconf:
sudo tar -zxvf autoconf-2.65.tar.gz
cd autoconf-2.65
sudo ./configure --prefix=/usr/local
sudo make
sudo make install
3)安装automake:
sudo tar -zxvf automake-1.13.tar.gz
cd automake-1.13
sudo ./configure --prefix=/usr/local
sudo make
sudo make install
4)安装libtool:
sudo tar -zxvf libtool-2.4.tar.gz
cd libtool-2.4
sudo ./configure --prefix=/usr/local
sudo make
sudo make install
5)安装ant:
sudo tar -zxvf apache-ant-1.9.0-bin.tar.gz
sudo gedit /etc/profile
export ANT_HOME=%ANT%
export PATH=$JAVA_HOME/bin:$ANT_HOME/bin:$PATH
source /etc/profile
4.安装eclipse:
eclipse-SDK-4.2-linux-gtk.tar.gz
sudo tar -zxvf eclipse-SDK-4.2-linux-gtk.tar.gz
5.解压hadoop:
hadoop-1.1.2.tar.gz
(1)解压到合适的目录:
sudo tar -zxvf hadoop-1.1.2.tar.gz
(2)拷贝%hadoop%/ivy/ivy-*.jar到%ant%/lib:
sudo cp /home/hep/hadoop/ivy/ivy-2.1.0.jar /home/hep/ant/lib/
二.配置hadoop:
1.设置用户的操作权限:
sudo chmod 777 -R hadoop
sudo chmod 777 -R hadoop
2.%hadoop%/src/contrib/eclipse-plugin/build.xml
1)取消ivy-download:
2)添加将要打包到plugin中的第三方jar包列表:
<!-- Override jar target to specify manifest -->
<target name="jar" depends="compile" unless="skip.contrib">
<mkdir dir="${build.dir}/lib"/>
<!-- 自定义的修改内容:begin -->
<!--
<copy file="${hadoop.root}/build/hadoop-core-${version}.jar"
tofile="${build.dir}/lib/hadoop-core.jar" verbose="true"/>
<copy file="${hadoop.root}/build/ivy/lib/Hadoop/common/commons-cli-${commons-cli.version}.jar"
todir="${build.dir}/lib" verbose="true"/>
-->
<copy file="${hadoop.root}/hadoop-core-${version}.jar" tofile="${build.dir}/lib/hadoop-core.jar" verbose="true"/>
<copy file="${hadoop.root}/lib/commons-cli-1.2.jar" todir="${build.dir}/lib" verbose="true"/>
<copy file="${hadoop.root}/lib/commons-configuration-1.6.jar" todir="${build.dir}/lib" verbose="true"/>
<copy file="${hadoop.root}/lib/commons-httpclient-3.0.1.jar" todir="${build.dir}/lib" verbose="true"/>
<copy file="${hadoop.root}/lib/commons-lang-2.4.jar" todir="${build.dir}/lib" verbose="true"/>
<copy file="${hadoop.root}/lib/jackson-core-asl-1.8.8.jar" todir="${build.dir}/lib" verbose="true"/>
<copy file="${hadoop.root}/lib/jackson-mapper-asl-1.8.8.jar" todir="${build.dir}/lib" verbose="true"/>
<!-- 自定义的修改内容:end -->
<jar
jarfile="${build.dir}/hadoop-${name}-${version}.jar"
manifest="${root}/META-INF/MANIFEST.MF">
<fileset dir="${build.dir}" includes="classes/ lib/"/>
<fileset dir="${root}" includes="resources/ plugin.xml"/>
</jar>
</target>
3.%hadoop%/src/contrib/build-contrib.xml :
1)添加hadoop的version和eclipse的eclipse.home属性:
<?xml version="1.0"?>
<!-- Imported by contrib/*/build.xml files to share generic targets. -->
<project name="hadoopbuildcontrib" xmlns:ivy="antlib:org.apache.ivy.ant">
<property name="name" value="${ant.project.name}"/>
<property name="root" value="${basedir}"/>
<property name="hadoop.root" location="${root}/../../../"/>
<!-- hadoop版本、eclipse安装路径 -->
<property name="version" value="1.1.2"/>
<property name="eclipse.home" location="%eclipse%"/>
2)取消ivy-download:
4.编辑%HADOOP_HOME%/build.xml:
1)修改hadoop版本号:
2)取消ivy-download:
5.修改%hadoop%/src/contrib/eclipse-plugin/META-INF/MANIFEST.MF:
修改${HADOOP_HOME}/src/contrib/eclipse-plugin/META-INF/MANIFEST.MF的Bundle-ClassPath:
Bundle-ClassPath: classes/,
lib/hadoop-core.jar,
lib/commons-cli-1.2.jar,
lib/commons-configuration-1.6.jar,
lib/commons-httpclient-3.0.1.jar,
lib/commons-lang-2.4.jar,
lib/jackson-core-asl-1.8.8.jar,
lib/jackson-mapper-asl-1.8.8.jar
三.执行ANT:
1.进入到%hadoop%/执行ant compile:
hep@hep-ubuntu:~/hadoop$ ant compile
#此处略去N行
init:
[echo] contrib: fairscheduler
[mkdir] Created dir: /home/hep/hadoop/build/contrib/fairscheduler
[mkdir] Created dir: /home/hep/hadoop/build/contrib/fairscheduler/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/fairscheduler/test
[mkdir] Created dir: /home/hep/hadoop/build/contrib/fairscheduler/system
[mkdir] Created dir: /home/hep/hadoop/build/contrib/fairscheduler/system/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/fairscheduler/examples
[mkdir] Created dir: /home/hep/hadoop/build/contrib/fairscheduler/test/logs
init-contrib:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
[ivy:configure] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#fairscheduler;working@hep-ubuntu
[ivy:resolve] confs: [common]
[ivy:resolve] found commons-logging#commons-logging;1.0.4 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.1 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.2 in maven2
[ivy:resolve] found log4j#log4j;1.2.15 in maven2
[ivy:resolve] found junit#junit;4.5 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in maven2
[ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in maven2
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in maven2
[ivy:resolve] found org.apache.commons#commons-math;2.1 in maven2
[ivy:resolve] found commons-lang#commons-lang;2.4 in maven2
[ivy:resolve] downloading http://repo1.maven.org/maven2/commons-collections/commons-collections/3.1/commons-collections-3.1.jar ...
[ivy:resolve] ..................
[ivy:resolve] ........................................
[ivy:resolve] .........................................
[ivy:resolve] ....................................... (546kB)
[ivy:resolve] .. (0kB)
[ivy:resolve] [SUCCESSFUL ] commons-collections#commons-collections;3.1!commons-collections.jar (7793ms)
[ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar ...
[ivy:resolve] ................................ (131kB)
[ivy:resolve] .. (0kB)
[ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#jsp-api-2.1;6.1.14!jsp-api-2.1.jar (2364ms)
[ivy:resolve] :: resolution report :: resolve 11591ms :: artifacts dl 10176ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 15 | 2 | 2 | 0 || 15 | 2 |
---------------------------------------------------------------------
ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#fairscheduler [sync]
[ivy:retrieve] confs: [common]
[ivy:retrieve] 15 artifacts copied, 0 already retrieved (4672kB/26ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
compile:
[echo] contrib: fairscheduler
[javac] /home/hep/hadoop/src/contrib/build-contrib.xml:191: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 21 source files to /home/hep/hadoop/build/contrib/fairscheduler/classes
[javac] 注: 某些输入文件使用或覆盖了已过时的 API。
[javac] 注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
check-libhdfs-fuse:
check-libhdfs-exists:
compile:
check-contrib:
init:
[echo] contrib: gridmix
[mkdir] Created dir: /home/hep/hadoop/build/contrib/gridmix
[mkdir] Created dir: /home/hep/hadoop/build/contrib/gridmix/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/gridmix/test
[mkdir] Created dir: /home/hep/hadoop/build/contrib/gridmix/system
[mkdir] Created dir: /home/hep/hadoop/build/contrib/gridmix/system/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/gridmix/examples
[mkdir] Created dir: /home/hep/hadoop/build/contrib/gridmix/test/logs
init-contrib:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
[ivy:configure] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#gridmix;working@hep-ubuntu
[ivy:resolve] confs: [common]
[ivy:resolve] found commons-logging#commons-logging;1.0.4 in maven2
[ivy:resolve] found log4j#log4j;1.2.15 in maven2
[ivy:resolve] found junit#junit;4.5 in maven2
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2
[ivy:resolve] found commons-codec#commons-codec;1.4 in maven2
[ivy:resolve] found commons-net#commons-net;3.1 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in maven2
[ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in maven2
[ivy:resolve] found org.mortbay.jetty#jsp-2.1;6.1.14 in maven2
[ivy:resolve] found asm#asm;3.2 in maven2
[ivy:resolve] found com.sun.jersey#jersey-core;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-json;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-server;1.8 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.2 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in maven2
[ivy:resolve] found commons-lang#commons-lang;2.4 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in maven2
[ivy:resolve] found commons-digester#commons-digester;1.8 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in maven2
[ivy:resolve] found org.apache.commons#commons-math;2.1 in maven2
[ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar ...
[ivy:resolve] ................................................................................
[ivy:resolve] ...........................................................................
[ivy:resolve] ............................................ (1000kB)
[ivy:resolve] .. (0kB)
[ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#jsp-2.1;6.1.14!jsp-2.1.jar (5438ms)
[ivy:resolve] :: resolution report :: resolve 3147ms :: artifacts dl 5453ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] commons-logging#commons-logging;1.0.4 by [commons-logging#commons-logging;1.1.1] in [common]
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [common]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [common]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 28 | 1 | 1 | 3 || 25 | 1 |
---------------------------------------------------------------------
ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#gridmix [sync]
[ivy:retrieve] confs: [common]
[ivy:retrieve] 25 artifacts copied, 0 already retrieved (7872kB/77ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
compile:
[echo] contrib: gridmix
[javac] /home/hep/hadoop/src/contrib/build-contrib.xml:191: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 44 source files to /home/hep/hadoop/build/contrib/gridmix/classes
[javac] 注: /home/hep/hadoop/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/PseudoLocalFs.java使用或覆盖了已过时的 API。
[javac] 注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
[javac] 注: 某些输入文件使用了未经检查或不安全的操作。
[javac] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
Trying to override old definition of task macro_tar
check-contrib:
init:
[echo] contrib: hdfsproxy
[mkdir] Created dir: /home/hep/hadoop/build/contrib/hdfsproxy
[mkdir] Created dir: /home/hep/hadoop/build/contrib/hdfsproxy/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/hdfsproxy/test
[mkdir] Created dir: /home/hep/hadoop/build/contrib/hdfsproxy/system
[mkdir] Created dir: /home/hep/hadoop/build/contrib/hdfsproxy/system/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/hdfsproxy/examples
[mkdir] Created dir: /home/hep/hadoop/build/contrib/hdfsproxy/test/logs
init-contrib:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
ivy-resolve-common:
[ivy:resolve] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#hdfsproxy;working@hep-ubuntu
[ivy:resolve] confs: [common]
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.0.4 in maven2
[ivy:resolve] found commons-cli#commons-cli;1.2 in maven2
[ivy:resolve] found log4j#log4j;1.2.15 in maven2
[ivy:resolve] found commons-logging#commons-logging-api;1.0.4 in maven2
[ivy:resolve] found junit#junit;4.5 in maven2
[ivy:resolve] found org.slf4j#slf4j-api;1.4.3 in maven2
[ivy:resolve] found org.slf4j#slf4j-log4j12;1.4.3 in maven2
[ivy:resolve] found xmlenc#xmlenc;0.52 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in maven2
[ivy:resolve] found asm#asm;3.2 in maven2
[ivy:resolve] found com.sun.jersey#jersey-core;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-json;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-server;1.8 in maven2
[ivy:resolve] found org.eclipse.jdt#core;3.1.1 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in maven2
[ivy:resolve] found commons-lang#commons-lang;2.4 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in maven2
[ivy:resolve] found commons-digester#commons-digester;1.8 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in maven2
[ivy:resolve] found org.apache.commons#commons-math;2.1 in maven2
[ivy:resolve] :: resolution report :: resolve 214ms :: artifacts dl 12ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] commons-logging#commons-logging;1.0.4 by [commons-logging#commons-logging;1.1.1] in [common]
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [common]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [common]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 29 | 0 | 0 | 3 || 26 | 0 |
---------------------------------------------------------------------
ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#hdfsproxy [sync]
[ivy:retrieve] confs: [common]
[ivy:retrieve] 26 artifacts copied, 0 already retrieved (9963kB/37ms)
[ivy:cachepath] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
compile:
[echo] contrib: hdfsproxy
[javac] /home/hep/hadoop/src/contrib/build-contrib.xml:191: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 12 source files to /home/hep/hadoop/build/contrib/hdfsproxy/classes
[javac] 注: /home/hep/hadoop/src/contrib/hdfsproxy/src/java/org/apache/hadoop/hdfsproxy/AuthorizationFilter.java使用了未经检查或不安全的操作。
[javac] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
compile:
[mkdir] Created dir: /home/hep/hadoop/build/contrib/hod
[copy] Copying 69 files to /home/hep/hadoop/build/contrib/hod
check-contrib:
init:
[echo] contrib: index
[mkdir] Created dir: /home/hep/hadoop/build/contrib/index
[mkdir] Created dir: /home/hep/hadoop/build/contrib/index/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/index/test
[mkdir] Created dir: /home/hep/hadoop/build/contrib/index/system
[mkdir] Created dir: /home/hep/hadoop/build/contrib/index/system/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/index/examples
[mkdir] Created dir: /home/hep/hadoop/build/contrib/index/test/logs
init-contrib:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
[ivy:configure] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#index;working@hep-ubuntu
[ivy:resolve] confs: [common]
[ivy:resolve] found commons-logging#commons-logging;1.0.4 in maven2
[ivy:resolve] found log4j#log4j;1.2.15 in maven2
[ivy:resolve] found junit#junit;4.5 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in maven2
[ivy:resolve] found asm#asm;3.2 in maven2
[ivy:resolve] found com.sun.jersey#jersey-core;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-json;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-server;1.8 in maven2
[ivy:resolve] found org.apache.lucene#lucene-core;2.3.1 in maven2
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in maven2
[ivy:resolve] found commons-lang#commons-lang;2.4 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in maven2
[ivy:resolve] found commons-digester#commons-digester;1.8 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in maven2
[ivy:resolve] found org.apache.commons#commons-math;2.1 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2
[ivy:resolve] downloading http://repo1.maven.org/maven2/org/apache/lucene/lucene-core/2.3.1/lucene-core-2.3.1.jar ...
[ivy:resolve] ........................................................
[ivy:resolve] ...................................................................................... (649kB)
[ivy:resolve] .. (0kB)
[ivy:resolve] [SUCCESSFUL ] org.apache.lucene#lucene-core;2.3.1!lucene-core.jar (4404ms)
[ivy:resolve] :: resolution report :: resolve 7903ms :: artifacts dl 4415ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] commons-logging#commons-logging;1.0.4 by [commons-logging#commons-logging;1.1.1] in [common]
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [common]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [common]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 22 | 1 | 1 | 3 || 19 | 1 |
---------------------------------------------------------------------
ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#index [sync]
[ivy:retrieve] confs: [common]
[ivy:retrieve] 19 artifacts copied, 0 already retrieved (6099kB/15ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
compile:
[echo] contrib: index
[javac] /home/hep/hadoop/src/contrib/build-contrib.xml:191: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 29 source files to /home/hep/hadoop/build/contrib/index/classes
[javac] 注: 某些输入文件使用或覆盖了已过时的 API。
[javac] 注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
[javac] 注: /home/hep/hadoop/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/IndexUpdateMapper.java使用了未经检查或不安全的操作。
[javac] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
check-contrib:
init:
[echo] contrib: streaming
[mkdir] Created dir: /home/hep/hadoop/build/contrib/streaming
[mkdir] Created dir: /home/hep/hadoop/build/contrib/streaming/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/streaming/test
[mkdir] Created dir: /home/hep/hadoop/build/contrib/streaming/system
[mkdir] Created dir: /home/hep/hadoop/build/contrib/streaming/system/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/streaming/examples
[mkdir] Created dir: /home/hep/hadoop/build/contrib/streaming/test/logs
init-contrib:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
[ivy:configure] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#streaming;working@hep-ubuntu
[ivy:resolve] confs: [common]
[ivy:resolve] found commons-cli#commons-cli;1.2 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.0.4 in maven2
[ivy:resolve] found junit#junit;4.5 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in maven2
[ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in maven2
[ivy:resolve] found asm#asm;3.2 in maven2
[ivy:resolve] found com.sun.jersey#jersey-core;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-json;1.8 in maven2
[ivy:resolve] found com.sun.jersey#jersey-server;1.8 in maven2
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2
[ivy:resolve] found log4j#log4j;1.2.15 in maven2
[ivy:resolve] found commons-codec#commons-codec;1.4 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in maven2
[ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in maven2
[ivy:resolve] found commons-lang#commons-lang;2.4 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in maven2
[ivy:resolve] found commons-digester#commons-digester;1.8 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in maven2
[ivy:resolve] found org.apache.commons#commons-math;2.1 in maven2
[ivy:resolve] :: resolution report :: resolve 144ms :: artifacts dl 21ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] commons-logging#commons-logging;1.0.4 by [commons-logging#commons-logging;1.1.1] in [common]
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [common]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [common]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 25 | 0 | 0 | 3 || 22 | 0 |
---------------------------------------------------------------------
ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#streaming [sync]
[ivy:retrieve] confs: [common]
[ivy:retrieve] 22 artifacts copied, 0 already retrieved (6473kB/16ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
compile:
[echo] contrib: streaming
[javac] /home/hep/hadoop/src/contrib/build-contrib.xml:191: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 36 source files to /home/hep/hadoop/build/contrib/streaming/classes
[javac] 注: /home/hep/hadoop/src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamUtil.java使用或覆盖了已过时的 API。
[javac] 注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
[javac] 注: 某些输入文件使用了未经检查或不安全的操作。
[javac] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
check-contrib:
init:
[echo] contrib: thriftfs
[mkdir] Created dir: /home/hep/hadoop/build/contrib/thriftfs
[mkdir] Created dir: /home/hep/hadoop/build/contrib/thriftfs/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/thriftfs/test
[mkdir] Created dir: /home/hep/hadoop/build/contrib/thriftfs/system
[mkdir] Created dir: /home/hep/hadoop/build/contrib/thriftfs/system/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/thriftfs/examples
[mkdir] Created dir: /home/hep/hadoop/build/contrib/thriftfs/test/logs
init-contrib:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
[ivy:configure] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#thriftfs;working@hep-ubuntu
[ivy:resolve] confs: [common]
[ivy:resolve] found commons-logging#commons-logging;1.0.4 in maven2
[ivy:resolve] found log4j#log4j;1.2.15 in maven2
[ivy:resolve] found commons-configuration#commons-configuration;1.6 in maven2
[ivy:resolve] found commons-collections#commons-collections;3.2.1 in maven2
[ivy:resolve] found commons-lang#commons-lang;2.4 in maven2
[ivy:resolve] found commons-logging#commons-logging;1.1.1 in maven2
[ivy:resolve] found commons-digester#commons-digester;1.8 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in maven2
[ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in maven2
[ivy:resolve] found org.apache.commons#commons-math;2.1 in maven2
[ivy:resolve] :: resolution report :: resolve 60ms :: artifacts dl 2ms
[ivy:resolve] :: evicted modules:
[ivy:resolve] commons-logging#commons-logging;1.0.4 by [commons-logging#commons-logging;1.1.1] in [common]
[ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [common]
[ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [common]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 12 | 0 | 0 | 3 || 9 | 0 |
---------------------------------------------------------------------
ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#thriftfs [sync]
[ivy:retrieve] confs: [common]
[ivy:retrieve] 9 artifacts copied, 0 already retrieved (2889kB/6ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
compile:
[echo] contrib: thriftfs
[javac] /home/hep/hadoop/src/contrib/build-contrib.xml:191: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 1 source file to /home/hep/hadoop/build/contrib/thriftfs/classes
init:
[mkdir] Created dir: /home/hep/hadoop/build/contrib/vaidya
[mkdir] Created dir: /home/hep/hadoop/build/contrib/vaidya/classes
[mkdir] Created dir: /home/hep/hadoop/build/contrib/vaidya/bin
[mkdir] Created dir: /home/hep/hadoop/build/contrib/vaidya/conf
[copy] Copying 1 file to /home/hep/hadoop/build/contrib/vaidya/bin
[copy] Copying 1 file to /home/hep/hadoop/build/contrib/vaidya/conf
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
[ivy:configure] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#vaidya;working@hep-ubuntu
[ivy:resolve] confs: [common]
[ivy:resolve] found commons-logging#commons-logging;1.0.4 in maven2
[ivy:resolve] found log4j#log4j;1.2.15 in maven2
[ivy:resolve] :: resolution report :: resolve 13ms :: artifacts dl 1ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 2 | 0 | 0 | 0 || 2 | 0 |
---------------------------------------------------------------------
ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#vaidya [sync]
[ivy:retrieve] confs: [common]
[ivy:retrieve] 2 artifacts copied, 0 already retrieved (419kB/6ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
compile:
[echo] contrib: vaidya
[javac] /home/hep/hadoop/src/contrib/build-contrib.xml:191: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 14 source files to /home/hep/hadoop/build/contrib/vaidya/classes
[javac] 注: /home/hep/hadoop/src/contrib/vaidya/src/java/org/apache/hadoop/vaidya/statistics/job/JobStatistics.java使用了未经检查或不安全的操作。
[javac] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
compile-ant-tasks:
[javac] /home/hep/hadoop/build.xml:2210: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 5 source files to /home/hep/hadoop/build/ant
[javac] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[javac] 1 个警告
compile:
BUILD SUCCESSFUL
Total time: 10 minutes 3 seconds
2.进入到%hadoop%/build/contrib/eclipse-plugin/执行 ant jar :
hep@hep-ubuntu:~$ cd ~/hadoop/src/contrib/eclipse-plugin
hep@hep-ubuntu:~/hadoop/src/contrib/eclipse-plugin$ ant jar
Buildfile: /home/hep/hadoop/src/contrib/eclipse-plugin/build.xml
check-contrib:
init:
[echo] contrib: eclipse-plugin
init-contrib:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
[ivy:configure] :: Ivy 2.1.0 - 20090925235825 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#eclipse-plugin;working@hep-ubuntu
[ivy:resolve] confs: [common]
[ivy:resolve] found commons-logging#commons-logging;1.0.4 in maven2
[ivy:resolve] found log4j#log4j;1.2.15 in maven2
[ivy:resolve] :: resolution report :: resolve 171ms :: artifacts dl 4ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 2 | 0 | 0 | 0 || 2 | 0 |
---------------------------------------------------------------------
ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#eclipse-plugin [sync]
[ivy:retrieve] confs: [common]
[ivy:retrieve] 0 artifacts copied, 2 already retrieved (0kB/6ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file = /home/hep/hadoop/ivy/ivysettings.xml
compile:
[echo] contrib: eclipse-plugin
[javac] /home/hep/hadoop/src/contrib/eclipse-plugin/build.xml:61: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
jar:
[mkdir] Created dir: /home/hep/hadoop/build/contrib/eclipse-plugin/lib
[copy] Copying 1 file to /home/hep/hadoop/build/contrib/eclipse-plugin/lib
[copy] Copying /home/hep/hadoop/hadoop-core-1.1.2.jar to /home/hep/hadoop/build/contrib/eclipse-plugin/lib/hadoop-core.jar
[copy] Copying 1 file to /home/hep/hadoop/build/contrib/eclipse-plugin/lib
[copy] Copying /home/hep/hadoop/lib/commons-cli-1.2.jar to /home/hep/hadoop/build/contrib/eclipse-plugin/lib/commons-cli-1.2.jar
[copy] Copying 1 file to /home/hep/hadoop/build/contrib/eclipse-plugin/lib
[copy] Copying /home/hep/hadoop/lib/commons-configuration-1.6.jar to /home/hep/hadoop/build/contrib/eclipse-plugin/lib/commons-configuration-1.6.jar
[copy] Copying 1 file to /home/hep/hadoop/build/contrib/eclipse-plugin/lib
[copy] Copying /home/hep/hadoop/lib/commons-httpclient-3.0.1.jar to /home/hep/hadoop/build/contrib/eclipse-plugin/lib/commons-httpclient-3.0.1.jar
[copy] Copying 1 file to /home/hep/hadoop/build/contrib/eclipse-plugin/lib
[copy] Copying /home/hep/hadoop/lib/commons-lang-2.4.jar to /home/hep/hadoop/build/contrib/eclipse-plugin/lib/commons-lang-2.4.jar
[copy] Copying 1 file to /home/hep/hadoop/build/contrib/eclipse-plugin/lib
[copy] Copying /home/hep/hadoop/lib/jackson-core-asl-1.8.8.jar to /home/hep/hadoop/build/contrib/eclipse-plugin/lib/jackson-core-asl-1.8.8.jar
[copy] Copying 1 file to /home/hep/hadoop/build/contrib/eclipse-plugin/lib
[copy] Copying /home/hep/hadoop/lib/jackson-mapper-asl-1.8.8.jar to /home/hep/hadoop/build/contrib/eclipse-plugin/lib/jackson-mapper-asl-1.8.8.jar
[jar] Building jar: /home/hep/hadoop/build/contrib/eclipse-plugin/hadoop-eclipse-plugin-1.1.2.jar
BUILD SUCCESSFUL
Total time: 3 seconds
生成的插件jar就在本目录中。
成品下载:http://download.csdn.net/detail/vigiles/5437791
来源:oschina
链接:https://my.oschina.net/u/256028/blog/132238