小编Raf*_*sin的帖子

Hadoop性能

我安装了hadoop 1.0.0并尝试了字数统计示例(单节点集群).完成需要2个48秒才能完成.然后我尝试了标准的linux字数统计程序,它在同一组(180 kB数据)上运行10毫秒.我做错了什么,或者Hadoop非常慢?

time hadoop jar /usr/share/hadoop/hadoop*examples*.jar wordcount someinput someoutput
12/01/29 23:04:41 INFO input.FileInputFormat: Total input paths to process : 30
12/01/29 23:04:41 INFO mapred.JobClient: Running job: job_201201292302_0001
12/01/29 23:04:42 INFO mapred.JobClient:  map 0% reduce 0%
12/01/29 23:05:05 INFO mapred.JobClient:  map 6% reduce 0%
12/01/29 23:05:15 INFO mapred.JobClient:  map 13% reduce 0%
12/01/29 23:05:25 INFO mapred.JobClient:  map 16% reduce 0%
12/01/29 23:05:27 INFO mapred.JobClient:  map 20% reduce 0%
12/01/29 23:05:28 INFO mapred.JobClient:  map 20% reduce 4%
12/01/29 23:05:34 INFO mapred.JobClient: …
Run Code Online (Sandbox Code Playgroud)

performance hadoop mapreduce

5
推荐指数
2
解决办法
8604
查看次数

标签 统计

hadoop ×1

mapreduce ×1

performance ×1