小编Pun*_*wal的帖子

如何在触发java代码时设置hadoop作业的优先级?

这就是我的职业运动员的样子.如何在触发此作业时设置低优先级?

public int run(String[] args) throws Exception {
    this.initJob();
    Path outputPath = new Path(args[2]);
    FileInputFormat.setInputPaths(job, args[0]);
    FileOutputFormat.setOutputPath(job, outputPath);

    job.getConfiguration().set("FREQUENCY", args[3]);
    job.getConfiguration().set("TIMEZONE", args[4]);

    boolean rc = job.waitForCompletion(true);
    if (rc) {
        return 0;
    }
    return 1;
}
public void initJob() throws IOException {
    job = new Job(getConf(), "Stats Data Cruncher");
    job.setMapOutputKeyClass(Text.class);       
    job.setMapOutputValueClass(Text.class);
    job.setOutputKeyClass(Text.class);
    job.setOutputValueClass(NullWritable.class);
    Job.setInputFormatClass(LzoTextInputFormat.class);  

    job.setJarByClass(JobRunner.class);
    job.setMapperClass(StatsMapper.class);
    job.setCombinerClass(StatsCombiner.class);        
    job.setReducerClass(StatsReducer.class);
}
Run Code Online (Sandbox Code Playgroud)

该行是否有效设置LOW优先级?

job.getConfiguration().set("PRIORITY", "LOW");
Run Code Online (Sandbox Code Playgroud)

java hadoop

2
推荐指数
1
解决办法
6011
查看次数

标签 统计

hadoop ×1

java ×1