小编Ujj*_*wan的帖子

在CDH4.0.1 VM上使用MRV1运行wordcount示例

我从https://downloads.cloudera.com/demo_vm/vmware/cloudera-demo-vm-cdh4.0.0-vmware.tar.gz下载了VM

我发现系统启动后,下面列出的服务正在运行.

  • MRV1服务

hadoop-0.20-mapreduce-jobtracker
hadoop-0.20-mapreduce-tasktracker

  • MRV2服务

hadoop-yarn-nodemanager
hadoop-yarn-resourcemanager
hadoop-mapreduce-historyserver

  • HDFS服务

hadoop-hdfs-namenode
hadoop-hdfs-datanode

单词计数示例运行正常并按预期生成输出

/usr/bin/hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar wordcount input output
Run Code Online (Sandbox Code Playgroud)

但是,上面使用MRv2-YARN框架运行

我的目标是使用MRv1运行.正如Cloudera文档中所建议的,我停止了MRV2服务,并编辑了/etc/hadoop/conf/mapred-site.xml

  <property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
  </property
Run Code Online (Sandbox Code Playgroud)

到"经典"(也试过"本地")

  <property>
    <name>mapreduce.framework.name</name>
    <value>classic</value>
  </property
Run Code Online (Sandbox Code Playgroud)

我希望它能够使用MRV1(jobtracker和tasktracker)运行.但是,我看到以下错误:

12/10/10 21:48:39 INFO mapreduce.Cluster: Failed to use org.apache.hadoop.mapred.LocalClientProtocolProvider due to error: Invalid "mapreduce.jobtracker.address" configuration value for LocalJobRunner : "172.30.5.21:8021"
12/10/10 21:48:39 ERROR security.UserGroupInformation: PriviledgedActionException as:cloudera (auth:SIMPLE) cause:java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
java.io.IOException: Cannot initialize Cluster. Please check …
Run Code Online (Sandbox Code Playgroud)

hadoop cloudera

10
推荐指数
1
解决办法
1万
查看次数

标签 统计

cloudera ×1

hadoop ×1