我正在四节点集群上的巨大数据集上运行一些 map reduce 任务,但退出代码出现异常 - 255
16/08/04 08:07:19 INFO mapreduce.Job: map 0% reduce 0%
16/08/04 08:07:27 INFO mapreduce.Job: Task Id : attempt_1470297644642_0001_m_000000_0, Status : FAILED
Exception from container-launch.
Container id: container_1470297644642_0001_01_000003
Exit code: 255
Stack trace: ExitCodeException exitCode=255:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:543)
at org.apache.hadoop.util.Shell.run(Shell.java:460)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:720)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:210)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 255
Run Code Online (Sandbox Code Playgroud)
在日志文件中 - SLF4J:
无法加载类“org.slf4j.impl.StaticLoggerBinder”。SLF4J:默认为无操作 (NOP) 记录器实现 SLF4J:参见 http://www.slf4j.org/codes.html#StaticLoggerBinder了解更多详情。??h???9?A@???P VERSIONAPPLICATION_ACL MODIFY_APPVIEW_APP APPLICATION_OWNEcentos(&container_1470297644642_0007_01_000007??stderr0stdout0syslog4142016-108.42016-108.42016-106:30016-108.42016-108.42016-108-3016-108.42016-108-3016-08-3016-08-3016-08-3016-08-2016-1070297644642_0007_01_0000007644642_0007_01_000007 5,main] 抛出错误。现在正在关闭... …
我正在使用 tf 指标来计算精度和召回率,但总是得到 0.0,但是当我自己计算时,我获得了很好的准确性,这是 tensorflow 的错误还是我做错了什么。
with tf.name_scope("pointwise_accuracy"):
correct_predictions = tf.equal(self.predictions, tf.argmax(self.input_y, 1))
self.classification_accuracy = tf.reduce_mean(tf.cast(correct_predictions, "float"), name="accuracy")
self.precision = tf.metrics.precision(self.input_y, self.logits, name="precison")[0]
Run Code Online (Sandbox Code Playgroud)
输出精度 - 0.0