小编bac*_*chr的帖子

Datanode守护程序未在Hadoop 2.5.0上运行

我在一台机器上设置Hadoop 2.5.0,我遇到的问题是没有运行的datanode,如jps命令的输出所示:

$ jps
3404 Jps
2661 NodeManager
2606 ResourceManager
2484 NameNode
Run Code Online (Sandbox Code Playgroud)

当我尝试手动运行它时,我得到了这个:

$HADOOP_HOME/sbin/hadoop-daemon.sh start datanode
starting datanode, logging to /home/arbi/Programs/hadoop-2.5.0/logs/hadoop-arbi-datanode-ElOued.out
Run Code Online (Sandbox Code Playgroud)

然后仍然没有,这里的内容是hadoop-arbi-datanode-ElOued.out:

ulimit -a for user arbi
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 15862
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, …
Run Code Online (Sandbox Code Playgroud)

java hadoop mapreduce hdfs hadoop-yarn

4
推荐指数
1
解决办法
6928
查看次数

hive上的MismatchedTokenException创建表查询

我正在尝试使用以下查询创建一个Hive表:

CREATE TABLE IF NOT EXISTS BXDataSet 
    (ISBN STRING, 
    BookTitle STRING, 
    BookAuthor STRING, 
    YearOfPublication STRING, 
    Publisher STRING, 
    ImageURLS STRING, 
    ImageURLM STRING, 
    ImageURLL STRING) 
COMMENT 'BX-Books Table' 
ROW FORMAT DELIMITED FIELDS TERMINATED BY ';' LINE TERMINATED BY '\n'
STORED AS TEXTFILE;
Run Code Online (Sandbox Code Playgroud)

我如何提交给Hive时遇到以下异常:

MismatchedTokenException(-1!=301)
    at org.antlr.runtime.BaseRecognizer.recoverFromMismatchedToken(BaseRecognizer.java:617)
    at org.antlr.runtime.BaseRecognizer.match(BaseRecognizer.java:115)
    at org.apache.hadoop.hive.ql.parse.HiveParser.tableRowFormatFieldIdentifier(HiveParser.java:31433)
    at org.apache.hadoop.hive.ql.parse.HiveParser.rowFormatDelimited(HiveParser.java:30386)
    at org.apache.hadoop.hive.ql.parse.HiveParser.tableRowFormat(HiveParser.java:30662)
    at org.apache.hadoop.hive.ql.parse.HiveParser.createTableStatement(HiveParser.java:4683)
    at org.apache.hadoop.hive.ql.parse.HiveParser.ddlStatement(HiveParser.java:2144)
    at org.apache.hadoop.hive.ql.parse.HiveParser.execStatement(HiveParser.java:1398)
    at org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:1036)
    at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:199)
    at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:166)
    at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:404)
    at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:322)
    at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:975)
    at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1040)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:911)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:901)
    at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
    at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220) …
Run Code Online (Sandbox Code Playgroud)

hadoop hive parseexception hiveql

4
推荐指数
1
解决办法
2万
查看次数

在 svg 中显示超赞的图标

我如何在 svg snipet 中显示一个 fontawesome 图标?我尝试了以下操作,但不起作用:

<svg xmlns="http://www.w3.org/2000/svg">
<g>
  <rect x="0" y="0" width="100" height="100" fill="red" ></rect>
  <text x="30" y="30" font-family="FontAwesome" font-size="20" fill="blue" >&#xf042;</text>
</g>
</svg>
Run Code Online (Sandbox Code Playgroud)

unicode&#xf042;对应于 fa-adjust 图标,可在此处找到。另外,我如何从图标的名称中获取 unicode?

html javascript unicode svg font-awesome

4
推荐指数
1
解决办法
4689
查看次数

如何使用Spark Dataset写入PostgreSQL hstore

我正在尝试将Spark数据集编写到现有的postgresql表中(不能像列类型那样更改表元数据).这个表的一个列是HStore类型,它会造成麻烦.

当我启动写入时,我看到以下异常(这里原始地图是空的,当转义时给出一个空字符串):

Caused by: java.sql.BatchUpdateException: Batch entry 0 INSERT INTO part_d3da09549b713bbdcd95eb6095f929c8 (.., "my_hstore_column", ..) VALUES (..,'',..) was aborted.  Call getNextException to see the cause.
    at org.postgresql.jdbc.BatchResultHandler.handleError(BatchResultHandler.java:136)
    at org.postgresql.core.v3.QueryExecutorImpl$1.handleError(QueryExecutorImpl.java:419)
    at org.postgresql.core.v3.QueryExecutorImpl$ErrorTrackingResultHandler.handleError(QueryExecutorImpl.java:308)
    at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2004)
    at org.postgresql.core.v3.QueryExecutorImpl.flushIfDeadlockRisk(QueryExecutorImpl.java:1187)
    at org.postgresql.core.v3.QueryExecutorImpl.sendQuery(QueryExecutorImpl.java:1212)
    at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:351)
    at org.postgresql.jdbc.PgStatement.executeBatch(PgStatement.java:1019)
    at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.savePartition(JdbcUtils.scala:222)
    at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$$anonfun$saveTable$1.apply(JdbcUtils.scala:300)
    at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$$anonfun$saveTable$1.apply(JdbcUtils.scala:299)
    at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(RDD.scala:902)
    at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(RDD.scala:902)
    at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1899)
    at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1899)
    at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
    at org.apache.spark.scheduler.Task.run(Task.scala:86)
    at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: org.postgresql.util.PSQLException: ERROR: column "my_hstore_column" is of type hstore but expression …
Run Code Online (Sandbox Code Playgroud)

postgresql jdbc hstore apache-spark spark-dataframe

4
推荐指数
1
解决办法
1262
查看次数

通过web.xml中的ContextLoaderListener初始化spring bean配置文件

在我web.xml,我声明ContextLoaderListener配置Spring应用程序是这样的:

<listener>    
   <listener-class>org.springframework.web.context.ContextLoaderListener</listener-class>    
</listener>
Run Code Online (Sandbox Code Playgroud)

在我的一个spring配置xml文件中,我使用不同的bean配置文件进行开发和生产.

<beans profile="production">
   <bean />
</beans
<beans profile="development">
   <bean />
</beans
Run Code Online (Sandbox Code Playgroud)

我如何设置默认的bean配置文件web.xml?当使用ContextLoaderListener而不是spring servlet 时,是否有类似于以下内容:

<init-param>
   <param-name>spring.profiles.active</param-name>
   <param-value>production</param-value>
</init-param>
Run Code Online (Sandbox Code Playgroud)

java spring web.xml servlet-listeners spring-bean

3
推荐指数
1
解决办法
1万
查看次数

UnregisteredNodeException导致slave上的dataNode失败启动

我有一台Hadoop 2.5集群的两台机器,在一台机器上,数据节点出现故障UnregisteredNodeException.这是主配置:

master$ jps
5036 Jps
7145 DataNode
918 ResourceManager
7338 SecondaryNameNode
6986 NameNode
1105 NodeManager
Run Code Online (Sandbox Code Playgroud)

对于奴隶

slave$ jps
15950 Jps
26650 NodeManager
Run Code Online (Sandbox Code Playgroud)

以下是来自以下内容的完整堆栈跟踪hadoop-hadoop-datanode-slave.log:

2014-10-23 19:43:46,895 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool BP-8947225-127.0.1.1-1409591980216 (Datanode Uuid 5c9f00ab-1d75-4706-8ed8-bfb449174c9a) service to hadoop-server/192.168.2.72:8020 is shutting down
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.UnregisteredNodeException): Data node DatanodeRegistration(192.168.2.73, datanodeUuid=5c9f00ab-1d75-4706-8ed8-bfb449174c9a, infoPort=50075, ipcPort=50020, storageInfo=lv=-55;cid=CID-ab378c59-62ed-44ff-8814-03b5b733b6fa;nsid=1290295317;c=0) is attempting to report storage ID 5c9f00ab-1d75-4706-8ed8-bfb449174c9a. Node 192.168.2.72:50010 is expected to serve this storage.
    at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.getDatanode(DatanodeManager.java:475)
    at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.processReport(BlockManager.java:1702)
    at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.blockReport(NameNodeRpcServer.java:1049)
    at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTranslatorPB.blockReport(DatanodeProtocolServerSideTranslatorPB.java:152)
    at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(DatanodeProtocolProtos.java:28061)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
    at …
Run Code Online (Sandbox Code Playgroud)

hadoop cluster-computing hdfs hadoop-yarn hadoop2

3
推荐指数
1
解决办法
1300
查看次数

在ActionBarSherlock中将位图设置为主图标

有没有办法将位图(表示从地址簿中检索的联系人照片)设置为ActionBarSherlock中的主页图标.

icons android bitmap actionbarsherlock

2
推荐指数
1
解决办法
2372
查看次数

rake无法加载这样的文件(LoadError)

rake尝试安装时遇到一个奇怪的错误,这就是它所说的

$ rake bundle_install
/usr/local/bin/rake:23:in `load': cannot load such file -- /usr/share/rubygems-integration/1.9.1/gems/rake-10.0.4/bin/rake (LoadError)
        from /usr/local/bin/rake:23:in `<main>'
Run Code Online (Sandbox Code Playgroud)

当我尝试导航到目录时,我什么也没找到:

$ ls /usr/share/rubygems-integration/1.9.1/
specifications/
Run Code Online (Sandbox Code Playgroud)

Ruby版本:

$ ruby -v
ruby 1.9.3p484 (2013-11-22 revision 43786) [x86_64-linux]
Run Code Online (Sandbox Code Playgroud)

为什么它试图加载错误的版本以及如何解决这个问题?

ruby rake gem ruby-on-rails bundler

1
推荐指数
1
解决办法
8475
查看次数