将特定MDC字段附加到logstash日志中

Den*_*nov 4 logging spring log4j logback logstash

我正在尝试将自定义字段添加到logback-spring.xml中的logstash appender中,如下所示:

<?xml version="1.0" encoding="UTF-8"?>
<configuration>
<appender name="stash" class="net.logstash.logback.appender.LogstashSocketAppender">
        <host>xx.xx.xx.xx</host>
        <port>xxxxx</port>
        <encoder class="net.logstash.logback.encoder.LogstashEncoder">
            <includeMdcKeyName>myField</includeMdcKeyName>
        </encoder>
</appender>

<root level="info">
    <appender-ref ref="stash" />
</root>

</configuration>
Run Code Online (Sandbox Code Playgroud)

它给了我错误:

线程"main"中的异常java.lang.IllegalStateException:检测到Logback配置错误:ch.qos.logback.core.joran.spi.Interpreter@34中的错误:71 - [编码器]没有适用的操作,当前ElementPath为[[配置] [附加器] [编码器]]

当我尝试使用控制台appender并尝试打印该字段时,就像下面的示例一样.

<layout>
      <Pattern>%-4r [%thread] %-5level My Field: [%X{myField:--}] %msg%n</Pattern>
</layout>
Run Code Online (Sandbox Code Playgroud)

你能告诉我我用udp appender做错了什么吗?谢谢你的建议.

mad*_*ead 8

你正在使用UDP appender,它没有encoder.您应该使用TCP Appender(LogstashTcpSocketAppender而不是LogstashSocketAppender):

<appender name="stash" class="net.logstash.logback.appender.LogstashTcpSocketAppender">
    <destination>xx.xx.xx.xx:xxxxx</destination>
    <encoder class="net.logstash.logback.encoder.LogstashEncoder">
        <includeMdcKeyName>myField</includeMdcKeyName>
    </encoder>
</appender>
Run Code Online (Sandbox Code Playgroud)

看看我在这里创建的一个演示项目.

这段代码(Kotlin):

MDC.put("mdc", "so53558553")

LOG.warn("Warn")
Run Code Online (Sandbox Code Playgroud)

logback-spring.xml这样的:

<appender name="logstash" class="net.logstash.logback.appender.LogstashTcpSocketAppender">
    <destination>localhost:5000</destination>
    <encoder class="net.logstash.logback.encoder.LogstashEncoder">
        <includeMdcKeyName>mdc</includeMdcKeyName>
    </encoder>
</appender>
Run Code Online (Sandbox Code Playgroud)

在Logstash中生成此类记录:

{
    "level_value" => 30000,
            "mdc" => "so53558553",
           "port" => 35450,
    "logger_name" => "by.dev.madhead.playgrounds.so53558553.SpringBootConsoleApplication",
           "host" => "172.17.0.1",
       "@version" => "1",
     "@timestamp" => 2018-12-03T01:16:28.793Z,
    "thread_name" => "main",
        "message" => "Warn",
          "level" => "WARN"
}
Run Code Online (Sandbox Code Playgroud)

<code>mdc</code>Logstash将值视为一个字段<code>LoggingEvent</code>.</p>

<p><strong>编辑</strong></p>

<p>由于ELK配置错误,您可能无法在Kibana看到您的字段.我正在粘贴我的Logstash pipiline config(<code>/etc/logstash/conf.d/01-input.conf</code>)仅供参考(这是非常基本的):</p>

<pre><code>input {
    tcp {
        port => 5000
        codec => json_lines
    }
}

output {
    elasticsearch {
        hosts => [ Run Code Online (Sandbox Code Playgroud)

然后我使用logback-*模式在Kibana中配置了日志:

创建索引模式-01 创建索引模式-02

瞧:

Kibana的MDC字段