纱线从属节点不与主节点通信？

Question

我做的时候无法看到我的节点yarn node -list,即使我已经配置/etc/hadoop/conf/yarn-site.xml了正确的属性(在我看来,至少根据这个问题,奴隶节点不在Yarn ResourceManager中).

这是我到目前为止所做的:

• 安装resourcemanager在主人身上
• 安装nodemanager在奴隶上

• yarn-site.xml在所有节点上检查:

  <property> <name>yarn.resourcemanager.hostname</name> <value>master-node</value> </property>

• 修改配置文件后,重新启动resourcemanager并nodemanager分别在主服务器和从服务器上.

但是,当我这样做时,yarn node -list我只能看到

Total Nodes: 0 
Node-Id       Node-state    Node-Http-Address      Number-of-Running-Containers

在我的节点,我查看了.out文件/var/log/hadoop-yarn/,我在其中看到:

ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 244592
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 32768
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 10240
cpu time               (seconds, -t) unlimited
max user processes              (-u) 65536
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

编辑: 当我看到.log文件时,我看到以下内容,但我不知道如何解决它:

    INFO org.apache.hadoop.service.AbstractService: Service NodeManager failed in state STARTED; cause:

org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: <master node ip>:8020:8031 (configuration property 'yarn.resourcemanager.resource-tracker.address')

Caused by: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: <master node ip>:8020:8031 (configuration property 'yarn.resourcemanager.resource-tracker.address')

如何将我的从节点连接到主节点？

Answer 1

please set all this properties and try
    <property>
        <name>yarn.resourcemanager.address</name>
        <value>master_node:8032</value>
      </property>
      <property>
        <name>yarn.resourcemanager.admin.address</name>
        <value>master_node:8033</value>
      </property>
      <property>
        <name>yarn.resourcemanager.scheduler.address</name>
        <value>master_node:8030</value>
      </property>
      <property>
        <name>yarn.resourcemanager.resource-tracker.address</name>
        <value>master_node:8031</value>
      </property>
      <property>
        <name>yarn.resourcemanager.webapp.address</name>
        <value>master_node:8088</value>
      </property>
      <property>
        <name>yarn.resourcemanager.webapp.https.address</name>
        <value>master_node:8090</value>
      </property>