fsi*_*fsi 7 hadoop hbase apache-pig
版本:Hadoop 2.2,Hbase 0.96.1,Pig 0.12
每当我运行这个猪脚本
raw_data = LOAD'ample_data.csv'使用PigStorage(',')AS(
listing_id:chararray,fname:chararray,lname:chararray);STORE raw_data INTO'hbase:// hello_world'USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:fname info:lname');
日志告诉我这个:
2014-01-15 20:12:30,788 [main-SendThread(hadoop-master:2181)] INFO org.apache.zookeeper.ClientCnxn - 建立到hadoop-master/50.50.1.15:2181的套接字连接,启动会话2014-01 -15 20:12:30,798 [main-SendThread(hadoop-master:2181)] INFO org.apache.zookeeper.ClientCnxn - 服务器上的会话建立完成hadoop-master/50.50.1.15:2181,sessionid = 0x14397878303000b,negotiated timeout = 90000
这似乎没问题,但10分钟后,这个错误告诉我:
2014-01-15 20:23:10,247 [main] ERROR org.apache.hadoop.hbase.mapreduce.TableOutputFormat - org.apache.hadoop.hbase.client.NoServerForRegionException:10次尝试后无法找到hello_world,99999999999999的区域.2014-01-15 20:23:10,250 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2999:意外的内部错误.org.apache.hadoop.hbase.client.NoServerForRegionException:尝试10次后无法找到hello_world,99999999999999的区域.
要检查一切是否正常,我输入此命令来检查:hbase hbck并给我这个:
Summary:
hbase:meta is okay.
Number of regions: 1
Deployed on: hadoop-master,60020,1389816680166
hello_world is okay.
Number of regions: 1
Deployed on: ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389816681502
hbase:namespace is okay.
Number of regions: 1
Deployed on: hadoop-master,60020,1389816680166
0 inconsistencies detected.
Status: OK
Run Code Online (Sandbox Code Playgroud)
在jps,我的群集给我HRegionServer和HQuorumPeer主人,Hmaster在我的主人
我的jps大师:
29660 ResourceManager
29264 NameNode
32372 HRegionServer
32064 HQuorumPeer
32159 HMaster
586 Jps
29513 SecondaryNameNode
31728 JobHistoryServer
Run Code Online (Sandbox Code Playgroud)
我的jps奴隶:
29817 Jps
29071 HRegionServer
26844 NodeManager
26665 DataNode
28731 JobHistoryServer
Run Code Online (Sandbox Code Playgroud)
只有错误才是hbase hbck因为它在动物园管理员继续之前运行和关闭我认为.而这个错误
2014-01-16 13:27:44,149 INFO [master:hadoop-master:60000] master.MasterFileSystem: Log folder hdfs://hadoop-master:8020/hbase/WALs/ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389878859822 belongs to an existing region server
2014-01-16 13:27:44,234 INFO [master:hadoop-master:60000] catalog.CatalogTracker: Failed verification of hbase:meta,,1 at address=ubuntu-5e1cfa86-44db-4cab-a902-2aa87485669f,60020,1389876721606, exception=org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region hbase:meta,,1 is not online
at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2585)
at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3952)
at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionInfo(HRegionServer.java:3369)
at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:19789)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2175)
at org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1879)
Run Code Online (Sandbox Code Playgroud)
有什么我想念的吗?
更新:可能的错误是jar文件不正确,hbase客户端正在尝试连接到master,我修复了它仍然有错误.
| 归档时间: |
|
| 查看次数: |
2531 次 |
| 最近记录: |