同样的问题如无法在Windows 10中启动主要的火花也未解决.
通过测试pyspark.cmd和spark-shell.cmd,我的火花效果很好
跑完后.\sbin\start-master.sh我得到了:
ps: unknown option -- o
Try 'ps --help' for more information.
starting org.apache.spark.deploy.master.Master, logging to C:\spark-1.6.1-bin-hadoop2.6/logs/spark--org.apache.spark.deploy.master.Master-1-%MY_USER_NAME%-PC.out
ps: unknown option -- o
Try 'ps --help' for more information.
failed to launch org.apache.spark.deploy.master.Master:
========================================
Picked up _JAVA_OPTIONS: -Xmx512M -Xms512M
full log in C:\spark-1.6.1-bin-hadoop2.6/logs/spark--org.apache.spark.deploy.master.Master-1-%MY_USER_NAME%-PC.out
Run Code Online (Sandbox Code Playgroud)
我试图访问Web UI,而localhost:4040正在使用localhost:8080无法访问.
我发现在%SPARK_HOME%/ logs文件夹中创建了.log文件.它们包含相同的内容:
Spark命令:
C:\Program Files\Java\jdk1.7.0_79\bin\java -cp C:\spark-1.6.1-bin-hadoop2.6/conf\;C:\spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-1.6.1-hadoop2.6.0.jar;C:\spark-1.6.1-bin-hadoop2.6\lib\datanucleus-api-jdo-3.2.6.jar;C:\spark-1.6.1-bin-hadoop2.6\lib\datanucleus-core-3.2.10.jar;C:\spark-1.6.1-bin-hadoop2.6\lib\datanucleus-rdbms-3.2.9.jar -Xms1g -Xmx1g -XX:MaxPermSize=256m org.apache.spark.deploy.master.Master --ip hahaha-PC --port 7077 --webui-port 8080
========================================
Picked up _JAVA_OPTIONS: -Xmx512M -Xms512M
Run Code Online (Sandbox Code Playgroud)
工作环境:Spark:1.6.1 Windows 10
期待您的回复,并感谢您的时间!
cmder的默认设置是包装文本输出.但是如何设置cmder不包装文本输出?
cmder,我的意思是:http://cmder.net/
当我在Windows系统上运行kafka代理时,我总是收到此错误:
log4j:ERROR Failed to rename [C:\Users\Administrator\Documents\kafka/logs/server.log] to [C:\Users\Administrator\Documents\kafka/logs/server.log.2017-09-20-09].
可以看到有一些“/”和“\”。所以我认为问题是由log4j目录设置引起的。有没有人遇到过类似的问题,请问我该如何解决这个问题?
我的设置:
Zookeeper->log4j.properties:
# Define some default values that can be overridden by system properties
zookeeper.root.logger=INFO, CONSOLE
zookeeper.console.threshold=INFO
zookeeper.log.dir=.
zookeeper.log.file=zookeeper.log
zookeeper.log.threshold=DEBUG
zookeeper.tracelog.dir=.
zookeeper.tracelog.file=zookeeper_trace.log
#
# ZooKeeper Logging Configuration
#
# Format is "<default threshold> (, <appender>)+
# DEFAULT: console appender only
log4j.rootLogger=${zookeeper.root.logger}
# Example with rolling log file
#log4j.rootLogger=DEBUG, CONSOLE, ROLLINGFILE
# Example with rolling log file and tracing
#log4j.rootLogger=TRACE, CONSOLE, ROLLINGFILE, TRACEFILE
#
# Log INFO level and above messages to …Run Code Online (Sandbox Code Playgroud) 我无法从“安装新软件”和 Eclipse Marketplace 中安装 Subclipse。
当我尝试安装 Subclipse 4.2.3 时,我得到了以下信息:

对于第三个选项“显示原始错误并构建我自己的解决方案”,我收到以下错误:
Cannot complete the install because of a conflicting dependency.
Software being installed: Subclipse 4.2.3.201707071932 (org.tigris.subversion.subclipse.feature.group 4.2.3.201707071932)
Software currently installed: Subversion Client Adapter (Required) 1.10.3 (org.tigris.subversion.clientadapter.feature.feature.group 1.10.3)
Only one of the following can be installed at once:
Subversion Client Adapter 1.10.3 (org.tigris.subversion.clientadapter 1.10.3)
Subversion Client Adapter 1.9.4.2 (org.tigris.subversion.clientadapter 1.9.4.2)
Cannot satisfy dependency:
From: Subversion Client Adapter (Required) 1.10.3 (org.tigris.subversion.clientadapter.feature.feature.group 1.10.3)
To: org.tigris.subversion.clientadapter [1.10.3]
Cannot satisfy dependency:
From: Subclipse 4.2.3.201707071932 (org.tigris.subversion.subclipse.feature.group …Run Code Online (Sandbox Code Playgroud) 选择要启动的工作空间后,弹出一个窗口,提示“发生了错误。请参阅日志文件* my_work_space.metadata.log”
日志是:
!ENTRY org.eclipse.osgi 4 0 2019-03-19 16:57:32.090
!MESSAGE Application error
!STACK 1
java.lang.NoClassDefFoundError: org/eclipse/core/resources/IContainer
at org.eclipse.ui.internal.ide.application.IDEApplication.start(IDEApplication.java:156)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:203)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:137)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:107)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:400)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:255)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:659)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:595)
at org.eclipse.equinox.launcher.Main.run(Main.java:1501)
Caused by: java.lang.ClassNotFoundException: An error occurred while automatically activating bundle org.eclipse.core.resources (1211).
at org.eclipse.osgi.internal.hooks.EclipseLazyStarter.postFindLocalClass(EclipseLazyStarter.java:126)
at org.eclipse.osgi.internal.loader.classpath.ClasspathManager.findLocalClass(ClasspathManager.java:557)
at org.eclipse.osgi.internal.loader.ModuleClassLoader.findLocalClass(ModuleClassLoader.java:331)
at org.eclipse.osgi.internal.loader.BundleLoader.findLocalClass(BundleLoader.java:395)
at org.eclipse.osgi.internal.loader.sources.SingleSourcePackage.loadClass(SingleSourcePackage.java:39)
at org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:469)
at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:422)
at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:414)
at org.eclipse.osgi.internal.loader.ModuleClassLoader.loadClass(ModuleClassLoader.java:153)
at java.lang.ClassLoader.loadClass(Unknown Source)
at …Run Code Online (Sandbox Code Playgroud) 我试图从MongoDB中的数组中获取元素。我认为聚合过滤器是适用的正确选择。但是我已经尝试了百万次,但仍然找不到问题所在。你能帮我一下吗?
MongoDB示例数据:
{
"_id" : 12,
"items" : [
{
"columns" : [
{
"title" : "hhh",
"value" : 10
},
{
"title" : "hahaha",
"value" : 20
}
]
},
{
"columns" : [
{
"title" : "hiii",
"value" : 50
}
]
}
]
}
Run Code Online (Sandbox Code Playgroud)
我的解决方案:
db.myCollection.aggregate([
{
$project: {
items: {
$filter: {
input: "$items",
as: "item",
cond: { $eq: [ "$$item.columns.title", "hahaha" ]}
}
}
}
}
]).pretty()
Run Code Online (Sandbox Code Playgroud)
我的结果:
{
"_id" : 15,
"items" : [ …Run Code Online (Sandbox Code Playgroud) 我有一个这样的端点:
@POST
public Response update(MyDocument myDocument){}
Run Code Online (Sandbox Code Playgroud)
如果请求无效,我的服务器将获得一些较长的日志,如下所示:
javax.servlet.ServletException: org.glassfish.jersey.server.ContainerException: com.fasterxml.jackson.core.JsonParseException: Unexpected character....
...
Caused by...
...
Caused by...
Run Code Online (Sandbox Code Playgroud)
很难完全避免该异常,所以我想知道如何捕获JsonParseException?
首先,我收到了这个错误:
org.postgresql.util.PSQLException: ERROR: column xxxx is of type oid but expression is of type bytea
Hint: You will need to rewrite or cast the expression.
Position: 318
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2182)
...
Run Code Online (Sandbox Code Playgroud)
在谷歌搜索一段时间后,我认为我应该将列类型从 oid 更改为 bytea。我在 UI pgAdmin 中尝试了这个:
ALTER TABLE theTableName
ALTER COLUMN xxxx TYPE bytea
Run Code Online (Sandbox Code Playgroud)
但我得到了错误:
ERROR: column "xxxx" cannot be cast automatically to type bytea
HINT: You might need to specify "USING xxxx::bytea".
SQL state: 42804
Run Code Online (Sandbox Code Playgroud)
然后我尝试:
ALTER TABLE theTableName
ALTER COLUMN xxxx TYPE bytea USING xxxx::bytea
Run Code Online (Sandbox Code Playgroud)
我收到了这个错误:
ERROR: …Run Code Online (Sandbox Code Playgroud) eclipse ×2
windows ×2
apache-kafka ×1
apache-spark ×1
cmder ×1
jackson ×1
jersey ×1
log4j ×1
logging ×1
mongodb ×1
postgresql ×1
settings ×1
subclipse ×1
windows-10 ×1