Comments (7)
yeah very few use copy_attn since the transformer. what is your use case because I was planning to drop this feature.
anyway I'll at this next week.
from opennmt-py.
Thanks! I suspected that this functionality might be phasing out. The use case is morphological reinflection (for example, https://sigmorphon.github.io/sharedtasks/), for which rnn models are still fairly competitive and copy attention is conceptually motivated and empirically useful. I believe I was able to load the model after making a small addition to model.load_state_dict. Would you want a PR for that? Or maybe you have another quick fix in mind on the checkpoint save side, or want to go ahead with the plan of removing copy attention for rnns altogether.
from opennmt-py.
do you see thoses two in the checkpoint ?
https://github.com/OpenNMT/OpenNMT-py/blob/master/onmt/modules/copy_generator.py#L69-L70
from opennmt-py.
Yes, thanks, they are both there in the checkpoint.
model = torch.load('model_step_100.pt')
model['generator'].keys()
> odict_keys(['linear.weight', 'linear.bias', 'linear_copy.weight', 'linear_copy.bias'])
from opennmt-py.
Can you git pull and tell me if it works for you?
from opennmt-py.
Thanks! Will do later this evening.
Update: Still getting the same error, unfortunately. I believe that in your edit, near lines 143-144 of model.py, keyname should be set equal to (name.removeprefix("generator.") +"."+ param_name ...
from opennmt-py.
closing. Reopen if needed.
from opennmt-py.
Related Issues (20)
- Error evaluating LM-prior checkpoint: HOT 1
- Supported SentencePiece parameters HOT 1
- List index out of range in onmt.utils.distributed.all_reduce_and_rescale_tensors:51
- Speech to Text Toy Data Could Not Be Downloaded HOT 3
- Translation API Not Working HOT 1
- How to use Huawei‘s NPU Ascend310 to install OpenNMT-py? HOT 1
- NaN values when training big transformer model HOT 1
- Support for torch 2.2 HOT 5
- Device side assert triggered on AWQ Mistral converted model HOT 2
- (Again, but different) AssertionError: assert model_dim % head_count == 0 HOT 2
- OpenNMT v3.5.0 training fails using Multi headed attention HOT 3
- Custom callbacks for metrics, saving checkpoints HOT 3
- AttributeError: 'Namespace' object has no attribute 'block_ngram_repeat'
- UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 55: invalid start byte HOT 1
- Index out of range
- Canʻt get past Sentencepiece subword tokenization with pretrained embeddings
- Issues with Custom SentencePiece Models and Pretrained Embeddings in Training
- Error when translating with scores (--with_scores) option enabled HOT 1
- Supported languages HOT 1
- [Bug - Translation server] - Missing `tgt`param in `translator.translate` method (allows some multilingual/seq2seq models to work properly)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from opennmt-py.