Describe the bug When trying to run one of the iwslt example conf

comment added to the <div class="Box Box--condensed my-2"

Basic iwslt config train failure due to directory errors about joeynmt HOT 1 CLOSED

mcognetta commented on June 14, 2024

Basic iwslt config train failure due to directory errors

from joeynmt.

Comments (1)

may- commented on June 14, 2024

comment added to the script

joeynmt/scripts/get_iwslt14_bpe.sh

Lines 6 to 15 in d6247c5

 ############## https://github.com/joeynmt/joeynmt/pull/216 

 # Usage: 

 # $ cd /path/to/joeynmt/scripts # Call this script from /path/to/joeynmt/scripts dir 

 # $ bash get_iwslt14_bpe.sh # This will create /path/to/joeynmt/test/data/iwslt14/{train | valid | test}.{en | de} 

 # # Make sure that /path/to/joeynmt/test/data/iwslt14/bpe.32000 exists, too. 

 # $ cd .. # now back to /path/to/joeynmt/ 

 # 

 # Train: comment out the `voc_file` lines in the data section -> vocab files will be created in the training process  

 # $ python -m joeynmt train configs/iwslt14_deen_bpe.yaml --skip-test 

 ##############

from joeynmt.

Related Issues (20)

Multi-GPU training. HOT 5
JoeyNMT v1 procedure is no more compatible with JoeyNMT v2 HOT 12
better config validation
"AutocastCPU only supports Bfloat16" error when following rnn_reverse tutorial HOT 5
RuntimeError: indices should be either on cpu or on the same device as the indexed tensor (cpu) HOT 1
AttributeError: module 'packaging' has no attribute 'version' HOT 2
Unit test FAIL: testSentencepieceTokenizer (test.unit.test_tokenizer.TestTokenizer) HOT 4
trg_mask generate problem HOT 4
Running build_vocab.py for wmt17_bpe with or without --joint? HOT 3
RuntimeError: indices should be either on cpu or on the same device as the indexed tensor (cpu) HOT 5
run predict function in Colab, get ConfigurationError: Invalid `batch_type` option.
(enhancement) Deploying trained models on HuggingFace Space HOT 2
Early stopping criteria is only checked for the `ReduceLROnPlateau` scheduler HOT 5
Link in Tutorial to Collab dead HOT 4
Tutorial - Test Set Evaluation HOT 5
Columns and DataType Not Explicitly Set on line 387 of datasets.py
Unit Test Fails - Windows Installation HOT 4
serving & ONNX compat ?
Implementing Knowledge distillation HOT 3

Basic iwslt config train failure due to directory errors about joeynmt HOT 1 CLOSED

Comments (1)

Related Issues (20)

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent

	############## https://github.com/joeynmt/joeynmt/pull/216
	# Usage:
	# $ cd /path/to/joeynmt/scripts # Call this script from /path/to/joeynmt/scripts dir
	# $ bash get_iwslt14_bpe.sh # This will create /path/to/joeynmt/test/data/iwslt14/{train \| valid \| test}.{en \| de}
	# # Make sure that /path/to/joeynmt/test/data/iwslt14/bpe.32000 exists, too.
	# $ cd .. # now back to /path/to/joeynmt/
	#
	# Train: comment out the `voc_file` lines in the data section -> vocab files will be created in the training process
	# $ python -m joeynmt train configs/iwslt14_deen_bpe.yaml --skip-test
	##############