Instruction on running bitextor_align_segments.py for Hunalign only? about bitextor HOT 1 CLOSED

Hi!

The script bitextor_align_segments.py is expected to be used after the document aligner step, so it can't be used directly the way you want. I've adapted the command so you can use it the way you want:

echo -e "src_index\ttrg_index\tsrc_url\ttrg_url\tsrc_text\ttrg_text\tsrc_tokenized\ttrg_tokenized" \
  | cat - <(paste <(echo -e "1\t1\tdoc_hu\tdoc_en") \
                  <(cat hunalign/examples/demo.hu.stem | base64 -w 0) <(cat hunalign/examples/demo.en.stem | base64 -w 0) \
                  <(cat hunalign/examples/demo.hu.stem | base64 -w 0) <(cat hunalign/examples/demo.en.stem | base64 -w 0)) \
  | python bitextor_align_segments.py --hunalign "hunalign/src/hunalign/hunalign"

The only problem I've detected is that the examples from hunalign can't be correctly decoded to UTF-8 after decoding from BASE64, so bitextor_align_segments.py throws an error. In Bitextor this shouldn't happen since the selected preprocessor should deal with this kind of problems, but since you're providing your own files in one of the scripts, you should take care of this problems.

from bitextor.