如何将apache zookeeper调试消息(AWS EMR)静音?

Mur*_*gul 6 hadoop mute amazon-web-services elastic-map-reduce apache-zookeeper

如何在AWS Elastic MapReduce主节点上静音DEBUG消息?

hbase(main):003:0> list
TABLE                                                                                                               
mydb                                                                                                                
1 row(s) in 0.0510 seconds

hbase(main):004:0> 00:25:17.104 [main-SendThread(ip-172-31-14-206.ec2.internal:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Got ping response for sessionid: 0x1493a5c3b78001b after 1ms

hbase(main):005:0* 00:26:17.165 [main-SendThread(ip-172-31-14-206.ec2.internal:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Got ping response for sessionid: 0x1493a5c3b78001b after 1ms
Run Code Online (Sandbox Code Playgroud)

Vit*_*t D 0

我不知道 Web UI 中是否有一些选项可以更改日志详细程度。但必须有一个 Zookeeper(使用 Log4j)配置文件夹${ZOOKEEPER_HOME}/conf,您可以在其中编辑文件logj4.properties并指定:

zookeeper.console.threshold=WARN
Run Code Online (Sandbox Code Playgroud)

但我认为这些更改必须不是直接在Zookeeper中完成,而是在HBase日志配置- ${HBASE_HOME}/conf(HBase也使用Log4j)中完成,因为HBase可以管理Zookeeper。那里可以编辑的参数很少:

# Define some default values that can be overridden by system properties
hbase.root.logger=INFO,console
hbase.security.logger=INFO,console

# Main log level
log4j.threshold=ALL

# Zookeeper log level
log4j.logger.org.apache.zookeeper=INFO
Run Code Online (Sandbox Code Playgroud)

要找到该文件,您可以尝试下一个命令:

$ find /* -name "log4j.properties" | grep -E "zookeeper|hbase"
/hadoop/zookeeper/conf/log4j.properties
/hadoop/hbase/conf/log4j.properties
Run Code Online (Sandbox Code Playgroud)