Comments (3)
It seems something is wrong. Can you give me more information? Are you using GPU? Can you share your config file?
from nmt-keras.
yes I use GPU on google colaboratory, I am using the default configuration: https://github.com/lvapeab/nmt-keras/blob/master/config.py but
MAX_INPUT_TEXT_LEN = 300,
Use_Cuda= True
these are different parameters
if I make validation data = 100 sample, this makes it fast.
but my valid is 7000 too long time
from nmt-keras.
Indeed, the validation time is linearly proportional w.r.t. the number of samples (currently, no batch decoding is implemented). So you may want to validate on a smaller set (but big enough to take generalizable takeaways). This time is also proportional to the number of max steps allowed in the beam search (MAX_OUTPUT_TEXT_LEN_TEST
). If the model hasn't learned yet to generate sentences of the adequate length, it will take longer, as the search will make this number of steps.
You should also take a look to your data and check whether it makes sense setting MAX_INPUT_TEXT_LEN=300
. If you are doing regular word-level MT, this value seems too high.
from nmt-keras.
Related Issues (20)
- Support for Factored Models ? HOT 1
- Confusion with opennmt-tf HOT 1
- Missing auto setup of required packages for running this library HOT 1
- How to use pretrained word2vec embeddings? HOT 1
- Getting error index out of range when training a Transformer model HOT 10
- Using CPU for inference with GPU-trained model HOT 20
- Evaluating perplexity HOT 4
- Getting error when using Tensorboard HOT 2
- Save perplexity on training and validation sets HOT 5
- Regd Rare Words/OOV Tokens ? HOT 9
- Sampling decoding HOT 1
- Strange behavior with plotting metrics for validation HOT 2
- Issue with ensemble scoring method HOT 3
- AssertionError: Reduction function "Noam" unimplemented! HOT 1
- Data Error ? HOT 6
- Detecting multiple GPUs HOT 9
- Training Error HOT 1
- Conversion to TFJS HOT 1
- Example Colab Fails HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nmt-keras.