Hadoop 2.2和Maven

Jak*_*kub 23 java hadoop maven

我想从Hadoop 1.2.1切换到Hadoop 2.2.在我的项目中,我正在使用Maven,它可以处理

  <dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-core</artifactId>
    <version>1.2.1</version>
</dependency>
Run Code Online (Sandbox Code Playgroud)

woithout任何问题,但无法将版本更改为2.2,因为它在中央maven存储库中不可用.

任何想法如何包含Hadoop 2.2.在我的maven-ized项目?

Ion*_*aru 36

大多数hadoop-core依赖项都可以在hadoop-client中找到:

<dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-client</artifactId>
    <version>2.2.0</version>
</dependency>
Run Code Online (Sandbox Code Playgroud)

  • 我也被Hadoop 2和maven困住了.所以在GitHub上创建了一个工作的https://github.com/alexcpn/WordCountHadoop2.这也是使用MRUnit及其maven依赖性的Hadoop JUnit测试的示例.所有来源基本上都来自WordCount示例和单元测试示例 (3认同)

zee*_*vfu 11

对于Hadoop 2.2.0,相应的包名应如下(2014.05.27):

<dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-common</artifactId>
    <version>2.2.0</version>
</dependency>
<dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-mapreduce-client-core</artifactId>
    <version>2.2.0</version>
</dependency>
<dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-hdfs</artifactId>
    <version>2.2.0</version>
</dependency>
Run Code Online (Sandbox Code Playgroud)

参考:
http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-common/2.2.0
http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-mapreduce-client-core/2.2 .0
http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-hdfs/2.2.0