我使用2.4.0 Spark-core和Spark-sql.
我正在尝试创建sparkSession,然后创建一个范围,然后将其写入表.
使用Scala跟随代码工作
val sparkSession = SparkSession
.builder()
.appName("Java Spark SQL basic example")
.config("spark.master", "local")
.getOrCreate();
sparkSession.range(10).write.option("path", "/tmp/test").saveAsTable("testData")
但是当我使用java执行相同的步骤时,它会失败.
SparkSession sparkSession = SparkSession.builder()
.appName("Java Spark SQL basic example")
.config("spark.master", "local")
.getOrCreate();
//create table
sparkSession.range(10).write().mode(SaveMode.Overwrite).option("path", "/tmp/test").saveAsTable("testData");
错误堆栈跟踪是:
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 10582
at com.thoughtworks.paranamer.BytecodeReadingParanamer$ClassReader.accept(BytecodeReadingParanamer.java:563)
at com.thoughtworks.paranamer.BytecodeReadingParanamer$ClassReader.access$200(BytecodeReadingParanamer.java:338)
at com.thoughtworks.paranamer.BytecodeReadingParanamer.lookupParameterNames(BytecodeReadingParanamer.java:103)
at com.thoughtworks.paranamer.CachingParanamer.lookupParameterNames(CachingParanamer.java:90)
at com.fasterxml.jackson.module.scala.introspect.BeanIntrospector$.getCtorParams(BeanIntrospector.scala:44)
at com.fasterxml.jackson.module.scala.introspect.BeanIntrospector$.$anonfun$apply$1(BeanIntrospector.scala:58)
at com.fasterxml.jackson.module.scala.introspect.BeanIntrospector$.$anonfun$apply$1$adapted(BeanIntrospector.scala:58)
at scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:240)
at scala.collection.Iterator.foreach(Iterator.scala:937)
at scala.collection.Iterator.foreach$(Iterator.scala:937)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1425)
at scala.collection.IterableLike.foreach(IterableLike.scala:70)
at scala.collection.IterableLike.foreach$(IterableLike.scala:69)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at scala.collection.TraversableLike.flatMap(TraversableLike.scala:240)
at scala.collection.TraversableLike.flatMap$(TraversableLike.scala:237)
at scala.collection.AbstractTraversable.flatMap(Traversable.scala:104)
at com.fasterxml.jackson.module.scala.introspect.BeanIntrospector$.findConstructorParam$1(BeanIntrospector.scala:58)
at …我正在使用JGit创建一个新的git存储库,以及该文件夹中已存在的所有内容,我保存为新分支.
我在用
Git.init().setDirectory(workingDir).call();
(在上面的语句之后创建了默认的master分支,所以我将它重命名为"backupBranch").因为主人我以后从远程主人克隆.
问题是当我按下backupbranch时,它被推动但没有我能够建立的远程跟踪.
来自终端:如果我使用git branch -vv结果是
master 5f1994c [origin/master] commitmsg
backupbranch 7a4d671 taking backup of file already in MyTests Folder..
根据链接使现有的Git分支跟踪一个远程分支？我可以使用
git branch -u upstream/foo终端指定推送backupbranch后的任何时间.
如何使用JGit实现它.
以下是我正在使用的代码
创建backupbranch
git.branchRename().setNewName(backUpName).call();
git.add().addFilepattern(".").call();
RevCommit commit = git.commit().setMessage("taking backup of file already in MyTests Folder..").call();
然后第一次推它.
Iterable<PushResult> pushResult = git.push().call();
请建议我为现有分支指定远程跟踪的方式.
我正在尝试基于websocket的简单MQTT客户端,并且在Chrome控制台上出现"Uncaught ReferenceError:Messaging is defined defined"错误.
<!DOCTYPE html>
<head>
<head>
<script src="mqttws31.js" type="text/javascript" charset="utf-8" async defer></script>
<script type="text/javascript">
var client;
var form = document.getElementById("tutorial");
function doConnect() {
var wsbroker = "test.mosquitto.org"; //mqtt websocket enabled broker
var wsport = 80 // port for above
var client = new Messaging.Client(wsbroker, wsport,
"myclientid_" + parseInt(Math.random() * 100, 10));
client.onConnect = onConnect;
client.onMessageArrived = onMessageArrived;
client.onConnectionLost = onConnectionLost;
client.connect({onSuccess:onConnect});
}
function doSubscribe() {
client.subscribe("/World");
}
function doSend() {
message = new Messaging.Message("Hello");
message.destinationName = "/World"; …我有两个 GitHub 帐户，它们都有不同的 SSH 密钥。
如果我使用终端检查连接，我可以使用两者进行连接，并且响应消息具有相应的用户名。
关键1：
ssh -i ~/.ssh/id_rsa.pub git@github.com
PTY allocation request failed on channel 0
Hi m-aamir-ashfaq! You've successfully authenticated, but GitHub does not provide shell access.
Connection to github.com closed.
关键2：
ssh -i ~/.ssh/id2_rsa.pub git@github.com
PTY allocation request failed on channel 0
Hi mutong2! You've successfully authenticated, but GitHub does not provide shell access.
Connection to github.com closed.
这里好像还行
但是当我使用 java (JSch) 时，我可以使用密钥 1 进行连接，但不能使用密钥 2 进行连接。
以下是代码：
JSch jsch = new JSch();
String host ="git@github.com"; …