About train data of clf.py about tableqa HOT 7 OPEN

Multilingual seems like a good suggestion.You need to have is the QA model and clf.py classifier to be available for multilinguals. Also, the tokenization,lemmatisation, etc are done mainly for english, probably might need to change everything for that too. So my best guess is we can adapt to languages like german, french, etc which follows similar structure to english and also could follow similar rules for the lemmatisation, tokenisation etc.

from tableqa.

Multilingual seems like a good suggestion.You need to have is the QA model and clf.py classifier to be available for multilinguals. Also, the tokenization,lemmatisation, etc are done mainly for english, probably might need to change everything for that too. So my best guess is we can adapt to languages like german, french, etc which follows similar structure to english and also could follow similar rules for the lemmatisation, tokenisation etc.

I had try EasyNMT
https://github.com/UKPLab/EasyNMT
opus-mt model to transform your wikidata.csv to other languages,
It seems that the translations are well formatted in intuition.

from tableqa.

That's okay for wikidata.csv, but what about the QA models?

from tableqa.

That's okay for wikidata.csv, but what about the QA models?

https://huggingface.co/deepset/xlm-roberta-large-squad2

from tableqa.

Interesting. Let's give this a shot, would you be able to contribute while we're at this task? It would also be good to have some fluency in the respective language as well.

from tableqa.

i will try to adapt it to chinese firstly.

from tableqa.

Cool. Feel free to ask questions on the go.
Also, the multilingual should be optional, as you already know. Like, agent.query_db(lang="chinese") likewise.

from tableqa.