代码:
LivyClient client = null;
try
{
String livyUrl = "http://dummy16814.zycus.net:8998";
client = new LivyClientBuilder().setURI(new URI(livyUrl)).build();
String piJar = "E:\\livy_old.jar";
System.err.printf("Uploading %s to the Spark context...\n", piJar);
client.uploadJar(new File(piJar)).get();
int samples = 10;
System.err.printf("Running PiJob with %d samples...\n", samples);
double pi = client.submit(new PiJob()).get();
System.out.println("Pi is roughly: " + pi);
}
finally
{
client.stop(true);
}
Run Code Online (Sandbox Code Playgroud)
上传jar时遇到异常
正在将E:\ livy_old.jar上载到Spark上下文...线程“主”中的异常java.util.concurrent.ExecutionException:java.io.IOException:错误的请求:“要求失败:本地路径/root/.livy-sessions /61a5e39c-d199-4bb8-967b-960b4e3e9ee3/livy_old.jar无法添加到用户会话。” 在java.util.concurrent.FutureTask.report(FutureTask.java:122)在java.util.concurrent.FutureTask.get(FutureTask.java:192)在com.zycus.spark.PiJob.main(PiJob.java:64) )由以下原因引起:java.io.IOException:错误的请求:“请求失败:本地路径/root/.livy-sessions/61a5e39c-d199-4bb8-967b-960b4e3e9ee3/livy_old.jar无法添加到用户会话中。” com.cloudera.livy.client.http.LivyConnection上的com.cloudera.livy.client.http.LivyConnection.sendRequest(LivyConnection.java:197)处。