通过主管和docker-compose从django输出彩色日志

Question

我的目标是在docker-compose日志中获取我的Django webservice的彩色日志.

1. 我使用docker-compose来管理基于Django框架的Web服务列表.

2. 每个容器运行一个my_init bash脚本,该脚本依次运行runit(这在我的案例中是历史性的)脚本,该脚本运行一个supervisord进程:

   my_init---runsvdir-+-runsv---run---supervisord-+-gunicorn---gunicorn
                      |                           |-nginx---8*[nginx]
                      |                           |-python---9*[python]
                      |                           |-python---python  (Django)
                      |                           `-redis-server---2*[{redis-server}]
                      `-runsv
   

3. Django服务器在WSGI中与Gunicorn连接,并通过Nginx提供服务

4. supervisord conf如下:

   [supervisord]
   http_port=/var/tmp/supervisor.sock ; (default is to run a UNIX domain socket server)
   stdout_logfile=/dev/stdout
   stdout_logfile_maxbytes=0
   stderr_logfile=/dev/stderr
   stderr_logfile_maxbytes=0
   
   [program:gunicorn_core_service]
   #environment=myapp_VENV=/opt/myapp/venv/
   environment=PYTHONPATH=/opt/myapp/myappServer/myappServer
   command = /opt/myapp/venv/bin/gunicorn wsgi -b 0.0.0.0:8000 --timeout 90 --access-logfile /dev/stdout --error-logfile /dev/stderr
   directory = /opt/myapp/myappServer
   user = root
   autostart=true
   autorestart=true
   redirect_stderr=true
   stdout_logfile=/dev/stdout
   stdout_logfile_maxbytes=0
   stderr_logfile=/dev/stderr
   stderr_logfile_maxbytes=0
   
   [program:django-celery]
   command=/opt/myapp/venv/bin/python ./manage.py celery --app=myappServer.celeryapp:app worker -B --loglevel=INFO
   directory=/opt/myapp/myappServer
   numprocs=1
   stdout_logfile=/dev/stdout
   stdout_logfile_maxbytes=0
   stderr_logfile=/dev/stderr
   stderr_logfile_maxbytes=0
   redirect_stderr=true
   autostart=true
   autorestart=true
   startsecs=10
   
   [program:nginx]
   command=nginx -g "daemon off;"
   #user = root
   autostart=true
   autorestart=true
   redirect_stderr=true
   stdout_logfile=/dev/stdout
   stdout_logfile_maxbytes=0
   stderr_logfile=/dev/stderr
   stderr_logfile_maxbytes=0
   

5. 由于docker只能记录一次进程,因此我的容器的所有进程的日志都被转发到/ dev/stdout和/ dev/stderr

6. 我使用colorlog作为颜色格式化器来着色Django日志:

   'formatters': {
       'color': {
           '()': 'colorlog.ColoredFormatter',
           'format': '%(log_color)s%(levelname)-8s %(message)s',
           'log_colors': {
               'DEBUG':    'bold_black',
               'INFO':     'white',
               'WARNING':  'yellow',
               'ERROR':    'red',
               'CRITICAL': 'bold_red',
           },
       }
   },
   

   • 当我从容器内部运行服务时

     ./manage.py runserver

     日志是彩色的.
   • 但是从外部来看,docker-compose日志没有着色.

我试着补充一下

tty: true

在我这里描述的服务中,但似乎它不再起作用了.

任何的想法？

Answer 1

这是与Gunicorn一起使用的Django应用程序的最小工作示例.诀窍是确保Gunicorn记录器配置为使用使用彩色格式化程序的处理程序.

settings.py

LOGGING = {
    'version': 1,
    'disable_existing_loggers': False,
    'formatters': {
        'colored_verbose': {
            '()': 'colorlog.ColoredFormatter',
            'format': "%(log_color)s%(levelname)-8s%(red)s%(module)-30s%(reset)s %(blue)s%(message)s"
        },
    },
    'handlers': {
        'colored_console': {
            'level': 'INFO',
            'class': 'logging.StreamHandler',
            'formatter': 'colored_verbose'
        }
    },
    'loggers': {
        '': {
            'level': 'INFO',
            'handlers': ['colored_console'],
        },
        'gunicorn.access': {
            'handlers': ['colored_console']
        },
        'gunicorn.error': {
            'handlers': ['colored_console']
        }
    }
}

终端输出

奖金

检查日志记录配置的最佳方法(根据我的经验)是使用logging_tree.

只需在您的应用程序上下文中执行此操作(例如在Django shell中)

import logging_tree
logging_tree.printout()

它应该打印现有记录器的一个很好的表示.

我更进了一步并将其添加到了我的urls.py所有记录器安装后我可以看到日志记录配置.

from django.conf.urls import url
from django.http import HttpResponse
import logging_tree

urlpatterns = [
    url(r'^loggers', loggers),
]

def loggers(request):
    """
    Returns a representation of the existing loggers
    """
    return HttpResponse(logging_tree.format.build_description()[:-1])

它应该返回类似于此的东西

<--""
   Level INFO
   Handler Stream <_io.TextIOWrapper name='<stderr>' mode='w' encoding='UTF-8'>
     Level INFO
     Formatter <colorlog.colorlog.ColoredFormatter object at 0x1103a1668>
   |
   o<--"django"
   |   Level INFO
   |   Handler Stream <_io.TextIOWrapper name='<stderr>' mode='w' encoding='UTF-8'>
   |     Level INFO
   |     Filter <django.utils.log.RequireDebugTrue object at 0x11047d518>
   |   Handler <AdminEmailHandler (ERROR)>
   |     Level ERROR
   |     Filter <django.utils.log.RequireDebugFalse object at 0x11053a7f0>
   |   |
   |   o<--"django.db"
   |   |   Level NOTSET so inherits level INFO
   |   |   |
   |   |   o<--"django.db.backends"
   |   |       Level NOTSET so inherits level INFO
   |   |       |
   |   |       o<--"django.db.backends.schema"
   |   |           Level NOTSET so inherits level INFO
   |   |
   |   o<--"django.request"
   |   |   Level NOTSET so inherits level INFO
   |   |
   |   o   "django.server"
   |   |   Level INFO
   |   |   Propagate OFF
   |   |   Handler Stream <_io.TextIOWrapper name='<stderr>' mode='w' encoding='UTF-8'>
   |   |     Level INFO
   |   |     Formatter <django.utils.log.ServerFormatter object at 0x11053a630>
   |   |
   |   o<--"django.template"
   |       Level NOTSET so inherits level INFO
   |
   o<--"gunicorn"
       Level NOTSET so inherits level INFO
       |
       o   "gunicorn.access"
       |   Level INFO
       |   Propagate OFF
       |   Handler Stream <_io.TextIOWrapper name='<stderr>' mode='w' encoding='UTF-8'>
       |     Level INFO
       |     Formatter <colorlog.colorlog.ColoredFormatter object at 0x1103a1668>
       |
       o   "gunicorn.error"
       |   Level INFO
       |   Propagate OFF
       |   Handler Stream <_io.TextIOWrapper name='<stderr>' mode='w' encoding='UTF-8'>
       |     Level INFO
       |     Formatter <colorlog.colorlog.ColoredFormatter object at 0x1103a1668>
       |
       o<--"gunicorn.http"
          Level NOTSET so inherits level INFO
           |
           o<--"gunicorn.http.wsgi"
               Level NOTSET so inherits level INFO