Comments (6)
To answer my own question:
What are the appropriate paths for answers_vocab.t7, questions_vocab.t7 and data.t7?
They should be in the data
folder.
from neural-vqa.
Training from scratch, i.e. generating answers_vocab.t7, questions_vocab.t7 and data.t7 works. But you need to install torch with
TORCH_LUA_VERSION=LUA51 ./install.sh
Version LUA52 cannot be installed, and LUA21 (the default) cannot allocate enough memory.
from neural-vqa.
@ilija139 I see, thanks! And were you able to fix the nan
training loss issue?
from neural-vqa.
To answer your first query, the checkpoint file is old. I added a bunch of things after that (Multi-layer LSTMs, thinner model checkpointing, etc), which is probably why it broke. :/ I'll fix it as soon as I can.
from neural-vqa.
@abhshkdz yes, the nan
training loss is solved when training from scratch.
These are the files I've just generated with the current version of the repo. If you want you can link them:
https://www.dropbox.com/s/ounll9zagxk8hp5/answers_vocab.t7?dl=0
https://www.dropbox.com/s/55hk5x2x2fh63sc/data.t7?dl=0
https://www.dropbox.com/s/ty6wm905oexk4rb/questions_vocab.t7?dl=0
https://www.dropbox.com/s/3vj6477ia5xmz2f/vqa_epoch15.00_0.4576.t7?dl=0
Anyway thanks for providing the code, it's easy to understand so it's useful as a starting point.
from neural-vqa.
@ilija139 I'll link these, thanks!
from neural-vqa.
Related Issues (15)
- not enough memory HOT 10
- LookupTable.lua:75: bad argument #3 to 'index' (Tensor | LongTensor expected, got torch.CudaLongTensor) HOT 3
- should this directory works well?
- what 's means about "not found: .......THNN.lua:108: NYI: call arg type " ? HOT 4
- Error while evaluating through pretrained checkpoint HOT 23
- cannot open <data/MultipleChoice_mscoco_train2014_questions.json> in mode r at /home/hadjer/torch/pkg/torch/lib/TH/THDiskFile.c:673 stack traceback: [C]: ? [C]: in function 'DiskFile' ./utils/DataLoader.lua:234: in function 'json_to_tensor' ./utils/DataLoader.lua:43: in function 'create' extract_fc7.lua:47: in main chunk [C]: in function 'dofile' .../torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk HOT 2
- 2vis-lstm
- work issue
- Performance on VQA test set HOT 3
- modify the code to do image caption HOT 2
- Error ---- predict.lua -checkpoint_file vqa_epoch15.00_0.4576.t7 -input_image_path data/train2014/COCO_train2014_000000405541.jpg -question 'What is the cat on?' HOT 7
- unknown Torch class <torch.CudaTensor> HOT 21
- cutorch not necessary for extracting image features on CPU HOT 1
- Performance and memory issue with training HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from neural-vqa.