Giter VIP home page Giter VIP logo

Comments (4)

tlhumphrey2 avatar tlhumphrey2 commented on May 14, 2024

Note. In my above post, all my back-slashes were left out.

from lstmvis.

sebastianGehrmann avatar sebastianGehrmann commented on May 14, 2024

Hey, can you try adding a rnn_size parameter to your call to get_states.lua?

th model/get_states.lua -data_file data/tinyshakespeare/convert/tiny-shakespeare.hdf5 
-checkpoint_file cv/tinyshakespeare_epoch20.00_420.16.t7 
-output_file data/reads/tinyshakespeare_states.h5 
-rnn_size 128

from lstmvis.

tlhumphrey2 avatar tlhumphrey2 commented on May 14, 2024

Thank you for your help. Adding -rnn_size 128 and -gpuid 0 fixed the problem. get_states.lua ran to completion.

from lstmvis.

tlhumphrey2 avatar tlhumphrey2 commented on May 14, 2024

Still having problems. Now with server.py. I did the following:
python server.py -dir data/reads
And get the following error message:
Traceback (most recent call last): File "server.py", line 266, in <module> create_data_handlers(args.dir) File "server.py", line 252, in create_data_handlers data_handlers[dh_id] = LSTMDataHandler(directory=p_dir, config=config) File "/home/ubuntu/cat-dog-data/LSTMVis/lstmdata/data_handler.py", line 66, in __init__ self.config['word_sequence']['size'] = list(self.h5_files[ws['file']][ws['path']].shape) File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper (/tmp/pip-4rPeHA-build/h5py/_objects.c:2684) File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper (/tmp/pip-4rPeHA-build/h5py/_objects.c:2642) File "/home/ubuntu/.local/lib/python2.7/site-packages/h5py/_hl/group.py", line 166, in __getitem__ oid = h5o.open(self.id, self._e(name), lapl=self._lapl) File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper (/tmp/pip-4rPeHA-build/h5py/_objects.c:2684) File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper (/tmp/pip-4rPeHA-build/h5py/_objects.c:2642) File "h5py/h5o.pyx", line 190, in h5py.h5o.open (/tmp/pip-4rPeHA-build/h5py/h5o.c:3570) KeyError: "Unable to open object (Object 'tiny-shakespeare.hdf5' doesn't exist)" ubuntu@ip-10-16-6-230:~/cat-dog-data/LSTMVis$ packet_write_wait: Connection to 54.214.11.185 port 22: Broken pipe
which is saying tiny-Shakespeare.hdf5 doesn't exist, but here is the contents of the directory data/reads:
-rw-rw-r-- 1 ubuntu ubuntu 920 Jun 8 14:28 lstm.yml -rw-r--r-- 1 ubuntu ubuntu 6263320 Jun 8 13:27 tiny-shakespeare.hdf5 -rw-rw-r-- 1 ubuntu ubuntu 39981152 Jun 8 13:20 tiny-shakespeare_states.h5 -rw-r--r-- 1 ubuntu ubuntu 302129 Jun 8 13:28 tiny-shakespeare.targ.dict
I have a feeling that my lstm.yml does NOT contain the right stuff. Here is it:
`name: tinyshakespeare # project name
description: this is a small sample of shakespeare's works # little description

files: # assign files to reference name
states: tiny-shakespeare_states.h5 # HDF5 files have to end with .h5 or .hdf5 !!!
train: tiny-shakespeare.hdf5 # word ids of training set
words: tiny-shakespeare.targ.dict # dict files have to end with .dict !!

word_sequence: # defines the word sequence
file: train # HDF5 file
path: tiny-shakespeare.hdf5 # path to table in HDF5
dict_file: words # dictionary to map IDs from HDF5 to words

states: # section to define which states of your model you want to look at
file: states # HDF5 files containing the state for each position
types: [
{type: state, layer: 1, path: states1}, # type={state, output}, layer=[1..x], path = HDF5 path
{type: state, layer: 2, path: states2},
{type: output, layer: 2, path: output2}
]
`
Any help would be most appreciated.

from lstmvis.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.