Can not print utf-8(e.g. Chinese) about structlog HOT 10 CLOSED

@ianbrayoni you can actually supply those kwargs to the JSONRenderer class through the dumps_kw argument. I ran into the same issue, but noticed this is the source code (snippet below):

class JSONRenderer(object):
    """
    Render the `event_dict` using ``serializer(event_dict, **json_kw)``.
    ....
    """
    def __init__(self, serializer=json.dumps, **dumps_kw):
        self._dumps_kw = dumps_kw
        self._dumps = serializer

    def __call__(self, logger, name, event_dict):
        return self._dumps(event_dict, default=_json_fallback_handler,
                           **self._dumps_kw)

from structlog.

I think you want structlog.processors.UnicodeEncoder.

from structlog.

Is this Python 2.7? You need UnicodeEncoder instead of UnicodeDecoder on legacy Python versions.

from structlog.

@hynek
Thanks for your commentary first ^_^
and then
I had tried both, and I had debugged it with the debug tool in Pycharm, and I tried it onece again when I saw your commentary. It was no helped. Here is my demo main code. Thank you for caring me again ^_^

import structlog
import tornado.options
from tornado import autoreload
from tornado.httpserver import HTTPServer
from tornado.ioloop import IOLoop
from tornado.wsgi import WSGIContainer
from flask import Flask

app = Flask(__name__)



if __name__ == '__main__':
    structlog.configure(
        processors=[
            structlog.processors.UnicodeEncoder(),
            structlog.processors.KeyValueRenderer(
                key_order=['event', 'request_id'],
            ),
        ],
        context_class=structlog.threadlocal.wrap_dict(dict),
        logger_factory=structlog.stdlib.LoggerFactory(),
    )
    tornado.options.parse_command_line()
    http_server = HTTPServer(WSGIContainer(app))
    http_server.listen(9998)
    instance = IOLoop.instance()
    autoreload.start(instance)
    instance.start()

from structlog.

OK I’ve looked further into this and it’s interesting!

Python 2:

>>> print(repr('哈哈哈'))
'\xe5\x93\x88\xe5\x93\x88\xe5\x93\x88'
>>> print(repr(u'哈哈哈'))
u'\u54c8\u54c8\u54c8'

Python 3:

>>> print(repr('哈哈哈'))
'哈哈哈'

Python 3 has simply a much better Unicode support.

I am not 100% sure what to make of it though. :(

from structlog.

So I think I found a workaround by adding a new option to (KeyValue|Console)Renderer:

>>> import structlog, sys, logging
>>> structlog.get_logger().info("哈哈哈", some_key="哈哈哈")
2016-12-09 12:52.52 哈哈哈                      some_key=哈哈哈
>>> handler = logging.StreamHandler(sys.stdout)
>>> root_logger = logging.getLogger()
>>> root_logger.addHandler(handler)
>>> structlog.configure(
...         processors=[
...             structlog.processors.UnicodeEncoder(),
...             structlog.processors.KeyValueRenderer(
...                 key_order=['event', 'request_id'], repr_native_str=False
...             ),
...         ],
...         context_class=structlog.threadlocal.wrap_dict(dict),
...         logger_factory=structlog.stdlib.LoggerFactory(),
...     )
>>> structlog.get_logger().warning("哈哈哈")
event=哈哈哈 request_id=None

It’s not on PyPI yet; would you mind testing it, if it works for you?

from structlog.

OK, I'll test it, and will tell you the result ,tks~~

from structlog.

It is worked!
And I am so exciting!!
I pip install form github, and the result is in the picture below
Thanks very much for solving this problem ~_~
If you push it to the PyPI, please kindly @ me here, thank you.

pip install git+https://github.com/hynek/structlog.git

from structlog.

It took a bit longer than I hoped, but 17.1 is on PyPI!

from structlog.

OK, thanks.

from structlog.