小编Spi*_*der的帖子

无法在Windows中启动Spark的master

同样的问题如无法在Windows 10中启动主要的火花也未解决.

通过测试pyspark.cmd和spark-shell.cmd,我的火花效果很好

跑完后.\sbin\start-master.sh我得到了:

ps: unknown option -- o
Try 'ps --help' for more information.
starting org.apache.spark.deploy.master.Master, logging to C:\spark-1.6.1-bin-hadoop2.6/logs/spark--org.apache.spark.deploy.master.Master-1-%MY_USER_NAME%-PC.out
ps: unknown option -- o
Try 'ps --help' for more information.
failed to launch org.apache.spark.deploy.master.Master:
  ========================================
  Picked up _JAVA_OPTIONS: -Xmx512M -Xms512M
full log in C:\spark-1.6.1-bin-hadoop2.6/logs/spark--org.apache.spark.deploy.master.Master-1-%MY_USER_NAME%-PC.out
Run Code Online (Sandbox Code Playgroud)

我试图访问Web UI,而localhost:4040正在使用localhost:8080无法访问.

我发现在%SPARK_HOME%/ logs文件夹中创建了.log文件.它们包含相同的内容:

Spark命令:

C:\Program Files\Java\jdk1.7.0_79\bin\java -cp C:\spark-1.6.1-bin-hadoop2.6/conf\;C:\spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-1.6.1-hadoop2.6.0.jar;C:\spark-1.6.1-bin-hadoop2.6\lib\datanucleus-api-jdo-3.2.6.jar;C:\spark-1.6.1-bin-hadoop2.6\lib\datanucleus-core-3.2.10.jar;C:\spark-1.6.1-bin-hadoop2.6\lib\datanucleus-rdbms-3.2.9.jar -Xms1g -Xmx1g -XX:MaxPermSize=256m org.apache.spark.deploy.master.Master --ip hahaha-PC --port 7077 --webui-port 8080

========================================
Picked up _JAVA_OPTIONS: -Xmx512M -Xms512M
Run Code Online (Sandbox Code Playgroud)

工作环境:Spark:1.6.1 Windows 10

期待您的回复,并感谢您的时间!

apache-spark windows-10

13
推荐指数
3
解决办法
1万
查看次数

如何设置cmder不包装文本输出

cmder的默认设置是包装文本输出.但是如何设置cmder不包装文本输出?

cmder,我的意思是:http://cmder.net/

windows settings cmder

8
推荐指数
2
解决办法
1754
查看次数

在Windows中设置Kafka日志目录属性

当我在Windows系统上运行kafka代理时,我总是收到此错误: log4j:ERROR Failed to rename [C:\Users\Administrator\Documents\kafka/logs/server.log] to [C:\Users\Administrator\Documents\kafka/logs/server.log.2017-09-20-09].

可以看到有一些“/”和“\”。所以我认为问题是由log4j目录设置引起的。有没有人遇到过类似的问题,请问我该如何解决这个问题?

我的设置:

Zookeeper->log4j.properties:

# Define some default values that can be overridden by system properties
zookeeper.root.logger=INFO, CONSOLE
zookeeper.console.threshold=INFO
zookeeper.log.dir=.
zookeeper.log.file=zookeeper.log
zookeeper.log.threshold=DEBUG
zookeeper.tracelog.dir=.
zookeeper.tracelog.file=zookeeper_trace.log

#
# ZooKeeper Logging Configuration
#

# Format is "<default threshold> (, <appender>)+

# DEFAULT: console appender only
log4j.rootLogger=${zookeeper.root.logger}

# Example with rolling log file
#log4j.rootLogger=DEBUG, CONSOLE, ROLLINGFILE

# Example with rolling log file and tracing
#log4j.rootLogger=TRACE, CONSOLE, ROLLINGFILE, TRACEFILE

#
# Log INFO level and above messages to …
Run Code Online (Sandbox Code Playgroud)

windows logging log4j apache-kafka apache-zookeeper

5
推荐指数
1
解决办法
1万
查看次数

无法在 Eclipse 中安装 Subclipse 插件

我无法从“安装新软件”和 Eclipse Marketplace 中安装 Subclipse。

当我尝试安装 Subclipse 4.2.3 时,我得到了以下信息: 在此输入图像描述


对于第二个选项“更新我的安装以与正在安装的项目兼容”: 在此输入图像描述

对于第三个选项“显示原始错误并构建我自己的解决方案”,我收到以下错误:

    Cannot complete the install because of a conflicting dependency.
  Software being installed: Subclipse 4.2.3.201707071932 (org.tigris.subversion.subclipse.feature.group 4.2.3.201707071932)
  Software currently installed: Subversion Client Adapter (Required) 1.10.3 (org.tigris.subversion.clientadapter.feature.feature.group 1.10.3)
  Only one of the following can be installed at once: 
    Subversion Client Adapter 1.10.3 (org.tigris.subversion.clientadapter 1.10.3)
    Subversion Client Adapter 1.9.4.2 (org.tigris.subversion.clientadapter 1.9.4.2)
  Cannot satisfy dependency:
    From: Subversion Client Adapter (Required) 1.10.3 (org.tigris.subversion.clientadapter.feature.feature.group 1.10.3)
    To: org.tigris.subversion.clientadapter [1.10.3]
  Cannot satisfy dependency:
    From: Subclipse 4.2.3.201707071932 (org.tigris.subversion.subclipse.feature.group …
Run Code Online (Sandbox Code Playgroud)

eclipse subclipse eclipse-plugin

5
推荐指数
1
解决办法
6233
查看次数

无法启动Eclipse,因为“尚未指定实例数据位置”

选择要启动的工作空间后,弹出一个窗口,提示“发生了错误。请参阅日志文件* my_work_space.metadata.log”

日志是:

!ENTRY org.eclipse.osgi 4 0 2019-03-19 16:57:32.090
!MESSAGE Application error
!STACK 1
java.lang.NoClassDefFoundError: org/eclipse/core/resources/IContainer
    at org.eclipse.ui.internal.ide.application.IDEApplication.start(IDEApplication.java:156)
    at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:203)
    at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:137)
    at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:107)
    at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:400)
    at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:255)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
    at java.lang.reflect.Method.invoke(Unknown Source)
    at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:659)
    at org.eclipse.equinox.launcher.Main.basicRun(Main.java:595)
    at org.eclipse.equinox.launcher.Main.run(Main.java:1501)
Caused by: java.lang.ClassNotFoundException: An error occurred while automatically activating bundle org.eclipse.core.resources (1211).
    at org.eclipse.osgi.internal.hooks.EclipseLazyStarter.postFindLocalClass(EclipseLazyStarter.java:126)
    at org.eclipse.osgi.internal.loader.classpath.ClasspathManager.findLocalClass(ClasspathManager.java:557)
    at org.eclipse.osgi.internal.loader.ModuleClassLoader.findLocalClass(ModuleClassLoader.java:331)
    at org.eclipse.osgi.internal.loader.BundleLoader.findLocalClass(BundleLoader.java:395)
    at org.eclipse.osgi.internal.loader.sources.SingleSourcePackage.loadClass(SingleSourcePackage.java:39)
    at org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:469)
    at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:422)
    at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:414)
    at org.eclipse.osgi.internal.loader.ModuleClassLoader.loadClass(ModuleClassLoader.java:153)
    at java.lang.ClassLoader.loadClass(Unknown Source)
    at …
Run Code Online (Sandbox Code Playgroud)

eclipse

5
推荐指数
1
解决办法
815
查看次数

在子文档数组字段中过滤数组

我试图从MongoDB中的数组中获取元素。我认为聚合过滤器是适用的正确选择。但是我已经尝试了百万次,但仍然找不到问题所在。你能帮我一下吗?

MongoDB示例数据:

{
    "_id" : 12,
    "items" : [
            {
                    "columns" : [
                            {
                                    "title" : "hhh",
                                    "value" : 10
                            },
                            {
                                    "title" : "hahaha",
                                    "value" : 20
                            }
                    ]
            },
            {
                    "columns" : [
                            {
                                    "title" : "hiii",
                                    "value" : 50
                            }
                    ]
            }
    ]
}
Run Code Online (Sandbox Code Playgroud)

我的解决方案:

    db.myCollection.aggregate([
   {
      $project: {
         items: {
            $filter: {
               input: "$items",
               as: "item",
               cond: { $eq: [ "$$item.columns.title", "hahaha" ]}
            }
         }
      }
   }
]).pretty()
Run Code Online (Sandbox Code Playgroud)

我的结果:

{
    "_id" : 15,
    "items" : [ …
Run Code Online (Sandbox Code Playgroud)

mongodb mongodb-query aggregation-framework

3
推荐指数
1
解决办法
1245
查看次数

如何从REST端点捕获JsonParseException

我有一个这样的端点:

@POST
public Response update(MyDocument myDocument){}
Run Code Online (Sandbox Code Playgroud)

如果请求无效,我的服务器将获得一些较长的日志,如下所示:

javax.servlet.ServletException: org.glassfish.jersey.server.ContainerException: com.fasterxml.jackson.core.JsonParseException: Unexpected character....
...
Caused by...
...
Caused by...
Run Code Online (Sandbox Code Playgroud)

很难完全避免该异常,所以我想知道如何捕获JsonParseException?

jersey jackson jackson-databind

2
推荐指数
1
解决办法
473
查看次数

如何在 PostgreSQL 中将列类型从 oid 更改为 bytea

首先,我收到了这个错误:

org.postgresql.util.PSQLException: ERROR: column xxxx is of type oid but expression is of type bytea
Hint: You will need to rewrite or cast the expression.
Position: 318
    at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2182)
...
Run Code Online (Sandbox Code Playgroud)

在谷歌搜索一段时间后,我认为我应该将列类型从 oid 更改为 bytea。我在 UI pgAdmin 中尝试了这个:

ALTER TABLE theTableName
ALTER COLUMN xxxx TYPE bytea
Run Code Online (Sandbox Code Playgroud)

但我得到了错误:

ERROR:  column "xxxx" cannot be cast automatically to type bytea
HINT:  You might need to specify "USING xxxx::bytea".
SQL state: 42804
Run Code Online (Sandbox Code Playgroud)

然后我尝试:

ALTER TABLE theTableName
ALTER COLUMN xxxx TYPE bytea USING xxxx::bytea
Run Code Online (Sandbox Code Playgroud)

我收到了这个错误:

ERROR: …
Run Code Online (Sandbox Code Playgroud)

postgresql

2
推荐指数
1
解决办法
2616
查看次数