Sha*_*deo 7 java client hadoop ipc resourcemanager
我是Hadoop的新手,所以我开始设置部分分布式的Hadoop集群localhost.我创建了一个wordcount程序jar来运行,但是当我运行这个jar时,会出现以下错误九次:
NFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:9040. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
Run Code Online (Sandbox Code Playgroud)
此外,当我键入jps命令时,我的服务启动是:
9154 DataNode
9777 NodeManager
8967 NameNode
9441 SecondaryNameNode
10060 Jps
Run Code Online (Sandbox Code Playgroud)
核心的site.xml
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/local/hadoop/tmp</value>
<description>A base for other temporary directories.</description>
</property>
<property>
<name>fs.file.impl</name>
<value>org.apache.hadoop.fs.LocalFileSystem</value>
<description>The FileSystem for file: uris.</description>
</property>
-
<property>
<name>fs.hdfs.impl</name>
<value>org.apache.hadoop.hdfs.DistributedFileSystem</value>
<description>The FileSystem for hdfs: uris.</description>
</property>
</configuration>
Run Code Online (Sandbox Code Playgroud)
纱的site.xml
<configuration>
<!-- Site specific YARN configuration properties -->
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
<property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>localhost:9025</value>
</property>
<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>localhost:9030</value>
</property>
<property>
<name>yarn.resourcemanager.address</name>
<value>localhost:9040</value>
</property>
<property>
<name>yarn.nodemanager.address</name>
<value>localhost:9050</value>
</property>
<property>
<name>yarn.nodemanager.localizer.address</name>
<value>localhost:9060</value>
</property>
</configuration>
Run Code Online (Sandbox Code Playgroud)
mapred-site.xml中
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>localhost:8021</value>
</property>
</configuration>
Run Code Online (Sandbox Code Playgroud)
帮助赞赏.我该如何解决这个问题?
| 归档时间: |
|
| 查看次数: |
5892 次 |
| 最近记录: |