Error in rule bicleaner about bitextor HOT 7 CLOSED

I am using the bicleaner stuff downloaded from the repositories flagged in github...is there any way to bypass the bicleaner? I dont think it was mandatory previously...

from bitextor.

OK I just commented out the bicleaner...

from bitextor.

yes I am trying to use the bicleaner, but following error being seen:

Error in rule bicleaner:
jobid: 10
output: /opt/bitextor/transient-default-en-fr-small/sentence-pair-testing/hunalign.bicleaner.scores.xz
shell:

    slang=$(egrep "source_lang" /opt/bitextor/bicleaner-model/en-fr.yaml | cut -d " " -f 2)
    if [ "$slang" == "fr" ]; then
      xzcat -T 0 -f /opt/bitextor/transient-default-en-fr-small/sentence-pair-testing/hunalign.bifixer.xz |
       /opt/bitextor/preprocess/bin/cache -k 6 python3 /opt/bitextor/bicleaner/bicleaner/bicleaner_classifier_lite.py --score_only -q - - /opt/bitextor/bicleaner-model/en-fr.yaml |
      paste <(xzcat -T 0 /opt/bitextor/transient-default-en-fr-small/sentence-pair-testing/hunalign.bifixer.xz) - |
      xz -T 0 > /opt/bitextor/transient-default-en-fr-small/sentence-pair-testing/hunalign.bicleaner.scores.xz
    else
      xzcat -T 0 -f /opt/bitextor/transient-default-en-fr-small/sentence-pair-testing/hunalign.bifixer.xz |
      awk ' BEGIN {FS="	"; OFS="	"} { t = $3; $3 = $4; $4 = t; print;}' |
       /opt/bitextor/preprocess/bin/cache -k 6 python3  /opt/bitextor/bicleaner/bicleaner/bicleaner_classifier_lite.py --score_only -q - - /opt/bitextor/bicleaner-model/en-fr.yaml |
      paste <(xzcat -T 0 /opt/bitextor/transient-default-en-fr-small/sentence-pair-testing/hunalign.bifixer.xz) - |
      xz -T 0 > /opt/bitextor/transient-default-en-fr-small/sentence-pair-testing/hunalign.bicleaner.scores.xz
    fi
    
    (one of the commands exited with non-zero exit code; note that snakemake uses bash strict mode!)

from bitextor.

Traceback (most recent call last):
File "/opt/bitextor/bicleaner/bicleaner/bicleaner_classifier_lite.py", line 135, in initialization
args.good_examples = metadata_yaml["good_examples"]
KeyError: 'good_examples'
terminate called after throwing an instance of 'util::EndOfFileException'
what(): End of file
/bin/bash: line 12: 376 Done xzcat -T 0 -f /opt/bitextor/transient-default-en-fr-small/sentence-pair-testing/hunalign.bifixer.xz
377 | awk ' BEGIN {FS=" "; OFS=" "} { t = $3; $3 = $4; $4 = t; print;}'
378 Aborted | /opt/bitextor/preprocess/bin/cache -k 6 python3 /opt/bitextor/bicleaner/bicleaner/bicleaner_classifier_lite.py --score_only -q - - /opt/bitextor/bicleaner-model/en-fr.yaml
379 | paste <(xzcat -T 0 /opt/bitextor/transient-default-en-fr-small/sentence-pair-testing/hunalign.bifixer.xz) -
380 | xz -T 0 > /opt/bitextor/transient-default-en-fr-small/sentence-pair-testing/hunalign.bicleaner.scores.xz
[Sat Mar 6 15:37:26 2021]

from bitextor.

Seems like you are using a modern model for Bicleaner (probably for version 0.14) and your Bitextor installation still uses a previous one (0.13 IIRC). Try using the ones for bicleaner 0.13: https://github.com/bitextor/bicleaner-data/releases/tag/v1.3

from bitextor.

OK thanks for getting back to me so quickly...will try

from bitextor.

RESULT...brilliant what you suggested worked 0.13 version fantastic!

from bitextor.