chinese-converter's Introduction

Chinese Converter

Converts between Traditional and Simplified Chinese. Uses monogram and bigram frequencies to pick optimal words when a 1-to-1 conversion is not possible.

Uses phrases in the dictionary to count monogram and bigram frequencies.

Installation

pip install chinese-converter

Usage

import chinese_converter

chinese_converter.to_traditional("simplified chinese text...")
chinese_converter.to_simplified("traditional chinese text...")

Testing

python -m unittest

License

MIT

Resources

Not necessary for the normal usage of this library.

Dictionary Files: https://resources.publicense.moe.edu.tw/dict_reviseddict_download.html
- Dictionary licensed under CC BY-ND 3.0 TW.
- Mirror: https://chinese-converter-data.s3.amazonaws.com/dict_revised_2015_20180409.zip

chinese-converter's People

Contributors

Stargazers

Watchers

chinese-converter's Issues

UnicodeDecodeError: 'gbk' codec can't decode byte 0x80 in position 2: illegal multibyte sequence

When I only import chinese_converter I get this

import chinese_converter
  File "E:\Study\Anaconda3\envs\whisper\lib\site-packages\chinese_converter\__init__.py", line 12, in <module>
    traditional, simplified = f.read().strip(), g.read().strip()
UnicodeDecodeError: 'gbk' codec can't decode byte 0x80 in position 2: illegal multibyte sequence

ps: 电脑的语言环境是简体中文

fails to import

Traceback (most recent call last):
  File "[...].py", line 1, in <module>
    import chinese_converter
  File "[...]\site-packages\chinese_converter\__init__.py", line 12, in <module>
    traditional, simplified = f.read().strip(), g.read().strip()
UnicodeDecodeError: 'cp932' codec can't decode byte 0x84 in position 71: illegal multibyte sequence

Recommend Projects