German Umlauts(ä, ö, ü) seem to throw ValueError exceptions about py-googletrans HOT 5 CLOSED

I added some debug lines to utils.py
def format_json(original):
# save state
states = []
text = original

LOGGER.debug("\n      text: %s", text)

The output seems to indicate the following: for text with umlaut, r.text from requests is not valid (not jason data): <title>Error 403 (Forbidden)!!1</title>

I do hope you'll be able to fix it.

$ python trans_clipboard.py
Mädchen
requests.packages.urllib3.connectionpool-connectionpool.py[ln:805]:INFO: Starting new HTTPS connection (1): translate.google.cn
requests.packages.urllib3.connectionpool-connectionpool.py[ln:401]:DEBUG: "GET /translate_a/single?client=t&dt=at&dt=bd&dt=ex&dt=ld&dt=md&dt=qca&dt=rw&dt=rm&dt=ss&dt=t&hl=zh-CN&ie=UTF-8&oe=UTF-8&otf=1&q=M%C3%A4dchen&sl=de&ssel=0&tk=651525.1024958&tl=zh-CN&tsel=0 HTTP/1.1" 403 1841
googletrans.client-client.py[ln:89]:DEBUG: from_cache: False
googletrans.utils-utils.py[ln:33]:DEBUG:
text:

403. That’s an error.

Your client does not have permission to get URL /translate_a/single?client=t&dt=at&dt=bd&dt=ex&dt=ld&dt=md&dt=qca&dt=rw&dt=rm&dt=ss&dt=t&hl=zh-CN&ie=UTF-8&oe=UTF-8&otf=1&q=M%C3%A4dchen&sl=de&ssel=0&tk=651525.1024958&tl=zh-CN&tsel=0 from this server. That’s all we know.

Traceback (most recent call last):
File "trans_clipboard.py", line 18, in
pyperclip.copy(translator.translate(text, src='de', dest=dest).text)
File "D:\Python34\lib\site-packages\googletrans\client.py", line 149, in translate
data = self._translate(text, dest, src)
File "D:\Python34\lib\site-packages\googletrans\client.py", line 91, in translate
data = utils.format_json(r.text)
File "D:\Python34\lib\site-packages\googletrans\utils.py", line 57, in format_json
converted = json.loads(text)
File "D:\Python34\lib\json_init.py", line 318, in loads
return _default_decoder.decode(s)
File "D:\Python34\lib\json\decoder.py", line 343, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "D:\Python34\lib\json\decoder.py", line 361, in raw_decode
raise ValueError(errmsg("Expecting value", s, err.value)) from None
ValueError: Expecting value: line 1 column 1 (char 0)

$ python trans_clipboard.py
Machen
requests.packages.urllib3.connectionpool-connectionpool.py[ln:805]:INFO: Starting new HTTPS connection (1): translate.google.cn
requests.packages.urllib3.connectionpool-connectionpool.py[ln:401]:DEBUG: "GET /translate_a/single?client=t&dt=at&dt=bd&dt=ex&dt=ld&dt=md&dt=qca&dt=rw&dt=rm&dt=ss&dt=t&hl=zh-CN&ie=UTF-8&oe=UTF-8&otf=1&q=Machen&sl=de&ssel=0&tk=88832.461243&tl=zh-CN&tsel=0 HTTP/1.1" 200 None
googletrans.client-client.py[ln:89]:DEBUG: from_cache: False
googletrans.utils-utils.py[ln:33]:DEBUG:
text: [[["使","Machen",null,null,0],[null,null,"Shǐ"]],null,"de",null,null,[["Machen",null,[["使",539,false,false],["让",281,false,fals
e],["令",115,false,false],["做",49,false,false],["使得",14,false,false]],[[0,6]],"Machen",0,1]],1,null,[["de"],null,[1],["de"]],null,null,null
,null,null,[["fertig machen","sauber machen","rückg\xe4ngig machen","bekannt machen","aufmerksam machen","kaputt machen","Urlaub machen","deu tlich machen","sich Sorgen machen","Sorgen machen"]]]
使

from py-googletrans.

This is because of the invalid token. It will take some time to fix this issue. Please wait a moment.

from py-googletrans.

remove_accents from EDIT in the thrid answer in http://stackoverflow.com/questions/517923/what-is-the-best-way-to-remove-accents-in-a-python-unicode-string

Seems to do the trick in the meantime... I was doing replace(umlauts, ae|oe|ue) for German, but remove_accents is much cleaner... and works for French as well...

# -*- coding: utf-8 -*-
import unicodedata


def remove_accents(input_str):
    nfkd_form = unicodedata.normalize('NFKD', input_str)
    return u"".join([c for c in nfkd_form if not unicodedata.combining(c)])

if __name__ == '__main__':
    from googletrans import Translator
    dest = 'zh-CN'
    translator = Translator()
    googletrans_text = lambda x: translator.translate(x, dest=dest).text

    text = 'Tatsächlich stimmten die Diagnosen der zuvor behandelnden Ärzte in nur zwölf Prozent (36 Fälle)'

    print(googletrans_text(remove_accents(text)))

    text = 'Une grande partie du camp d’accueil de migrants de la Linière, ouvert en mars 2016 à Grande-Synthe (Nord), a été ravagée par un incendie dans la nuit de lundi à mardi.'
    print(googletrans_text(remove_accents(text)))

from py-googletrans.

remove_accents cant handle "Weiß".
There can be other cases ……

from py-googletrans.

I'm trying to fix this issue as soon as possible but it may take some time to fix this issue as this is related to the token generator.

from py-googletrans.