Comments (4)
Note. In my above post, all my back-slashes were left out.
from lstmvis.
Hey, can you try adding a rnn_size
parameter to your call to get_states.lua?
th model/get_states.lua -data_file data/tinyshakespeare/convert/tiny-shakespeare.hdf5
-checkpoint_file cv/tinyshakespeare_epoch20.00_420.16.t7
-output_file data/reads/tinyshakespeare_states.h5
-rnn_size 128
from lstmvis.
Thank you for your help. Adding -rnn_size 128 and -gpuid 0 fixed the problem. get_states.lua ran to completion.
from lstmvis.
Still having problems. Now with server.py. I did the following:
python server.py -dir data/reads
And get the following error message:
Traceback (most recent call last): File "server.py", line 266, in <module> create_data_handlers(args.dir) File "server.py", line 252, in create_data_handlers data_handlers[dh_id] = LSTMDataHandler(directory=p_dir, config=config) File "/home/ubuntu/cat-dog-data/LSTMVis/lstmdata/data_handler.py", line 66, in __init__ self.config['word_sequence']['size'] = list(self.h5_files[ws['file']][ws['path']].shape) File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper (/tmp/pip-4rPeHA-build/h5py/_objects.c:2684) File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper (/tmp/pip-4rPeHA-build/h5py/_objects.c:2642) File "/home/ubuntu/.local/lib/python2.7/site-packages/h5py/_hl/group.py", line 166, in __getitem__ oid = h5o.open(self.id, self._e(name), lapl=self._lapl) File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper (/tmp/pip-4rPeHA-build/h5py/_objects.c:2684) File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper (/tmp/pip-4rPeHA-build/h5py/_objects.c:2642) File "h5py/h5o.pyx", line 190, in h5py.h5o.open (/tmp/pip-4rPeHA-build/h5py/h5o.c:3570) KeyError: "Unable to open object (Object 'tiny-shakespeare.hdf5' doesn't exist)" ubuntu@ip-10-16-6-230:~/cat-dog-data/LSTMVis$ packet_write_wait: Connection to 54.214.11.185 port 22: Broken pipe
which is saying tiny-Shakespeare.hdf5 doesn't exist, but here is the contents of the directory data/reads:
-rw-rw-r-- 1 ubuntu ubuntu 920 Jun 8 14:28 lstm.yml -rw-r--r-- 1 ubuntu ubuntu 6263320 Jun 8 13:27 tiny-shakespeare.hdf5 -rw-rw-r-- 1 ubuntu ubuntu 39981152 Jun 8 13:20 tiny-shakespeare_states.h5 -rw-r--r-- 1 ubuntu ubuntu 302129 Jun 8 13:28 tiny-shakespeare.targ.dict
I have a feeling that my lstm.yml does NOT contain the right stuff. Here is it:
`name: tinyshakespeare # project name
description: this is a small sample of shakespeare's works # little description
files: # assign files to reference name
states: tiny-shakespeare_states.h5 # HDF5 files have to end with .h5 or .hdf5 !!!
train: tiny-shakespeare.hdf5 # word ids of training set
words: tiny-shakespeare.targ.dict # dict files have to end with .dict !!
word_sequence: # defines the word sequence
file: train # HDF5 file
path: tiny-shakespeare.hdf5 # path to table in HDF5
dict_file: words # dictionary to map IDs from HDF5 to words
states: # section to define which states of your model you want to look at
file: states # HDF5 files containing the state for each position
types: [
{type: state, layer: 1, path: states1}, # type={state, output}, layer=[1..x], path = HDF5 path
{type: state, layer: 2, path: states2},
{type: output, layer: 2, path: output2}
]
`
Any help would be most appreciated.
from lstmvis.
Related Issues (20)
- make get_states.lua work without setting -rnn_size.
- sort top_k.lua output.
- Python module helper_functions is missing HOT 4
- package versions
- ModuleNotFoundError: No module named 'helper_functions' HOT 2
- Clarification on states HDF5 input HOT 3
- View Visualization for my HDF5 Dataset
- use LSTMVis with OpenNMT HOT 2
- Porting to Python 3.5? HOT 1
- Possible minor bug in Keras instruction HOT 1
- Match View not working!! HOT 3
- SwaggerValidationError 'states,words' is not of type 'array' HOT 6
- Uncaught ReferenceError: HeatMap is not defined HOT 1
- python2 import connexion will show error! What can i do? HOT 3
- KeyError: "Unable to open object ..." - lstm.yml HOT 2
- Closed HOT 1
- Choosing Activation values as threshold
- Using with Regression problem
- Parens Dataset not accessible
- Using LSTMVis in video
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lstmvis.