运行hadoop时出错

Question

haduser@user-laptop:/usr/local/hadoop$ bin/hadoop dfs -copyFromLocal /tmp/input 
/user/haduser/input

11/12/14 14:21:00 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 0 time(s).

11/12/14 14:21:01 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 1 time(s).

11/12/14 14:21:02 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 2 time(s).

11/12/14 14:21:03 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 3 time(s).

11/12/14 14:21:04 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 4 time(s).

11/12/14 14:21:05 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 5 time(s).

11/12/14 14:21:06 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 6 time(s).

11/12/14 14:21:07 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. -Already tried 7 time(s).

11/12/14 14:21:08 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 8 time(s).

11/12/14 14:21:09 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:54310. Already tried 9 time(s).

Bad connection to FS. command aborted. exception: Call to localhost/127.0.0.1:54310 failed on connection exception: java.net.ConnectException: Connection refused

当我尝试从中复制文件时,我收到上述错误/tmp/input,/user/haduser/input即使该文件/etc/hosts包含localhost的条目.当jps command运行时,TaskTracker并namenode没有列出.

可能是什么问题呢？请有人帮我这个.

Answer 1

我有类似的问题 - 实际上Hadoop与IPv6绑定.然后我添加 - " export HADOOP_OPTS=-Djava.net.preferIPv4Stack=true"来$HADOOP_HOME/conf/hadoop-env.sh

即使我在系统上禁用了IPv6,Hadoop也会绑定到IPv6.一旦我将它添加到env,就开始正常工作了.

希望这有助于某人.

Answer 2

NameNode (NN) 维护 HDFS 的命名空间，它应该在 HDFS 上运行以进行文件系统操作。检查日志，了解 NN 尚未启动的原因。HDFS上的操作不需要TaskTracker，只需要NN和DN就足够了。查看http://goo.gl/8ogSk和http://goo.gl/NIWoK教程，了解如何在单节点和多节点上设置 Hadoop。