适用于Hadoop 2.6.0的pom.xml

Question

我正在尝试使用Hadoop实现app =>从天气数据中找到最高温度(来自Tom White的书籍Hadoop:Definitive Guide(第3版)).我已经下载并安装了Hadoop 2.6.0我应该添加哪些依赖项才能使其正常工作？

Answer 1

一步步 :

1. 添加cloudera您的settings.xml(在$ {HOME} /.m2/settings.xml下)以访问hadoop依赖项

   <repository>
        <id>cloudera</id>
        <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
        <releases>
             <enabled>true</enabled>
        </releases>
        <snapshots>
             <enabled>true</enabled>
        </snapshots>
   </repository>
   

2. 将hadoop依赖项添加到pom.xml.

   <dependency>
       <groupId>org.apache.hadoop</groupId>
       <artifactId>hadoop-hdfs</artifactId>
       <version>2.6.0</version>
   </dependency>
   <dependency>
       <groupId>org.apache.hadoop</groupId>
       <artifactId>hadoop-auth</artifactId>
       <version>2.6.0</version>
   </dependency>
   <dependency>
       <groupId>org.apache.hadoop</groupId>
       <artifactId>hadoop-common</artifactId>
       <version>2.6.0</version>
   </dependency>
   <dependency>
       <groupId>org.apache.hadoop</groupId>
       <artifactId>hadoop-core</artifactId>
       <version>1.2.1</version>
   </dependency>
   

3. 然后尝试将"mvn clean install"命令放入包含pom.xml文件的项目文件夹中.