bartvm / mimir Goto Github PK
View Code? Open in Web Editor NEWJSON-based logging framework
License: MIT License
JSON-based logging framework
License: MIT License
Right now you can only choose the ports to use if you construct the _Logger
object manually, but when multiple users share workstations this should probably be accessible through the Logger
constructor as well.
When running through the README.md
in Deep Complex Networks, which utilizes Mímir for logging, I am met with this error:
Traceback (most recent call last):
File "/home/oisin/DCN/bin/train.py", line 4, in <module>
__import__('pkg_resources').run_script('DeepComplexNetworks==1', 'train.py')
File "/home/oisin/DCN/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 750, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/home/oisin/DCN/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 1534, in run_script
exec(script_code, namespace, namespace)
File "/home/oisin/DCN/local/lib/python2.7/site-packages/DeepComplexNetworks-1-py2.7.egg/EGG-INFO/scripts/train.py", line 142, in <module>
File "/home/oisin/DCN/local/lib/python2.7/site-packages/DeepComplexNetworks-1-py2.7.egg/EGG-INFO/scripts/train.py", line 112, in main
File "/home/oisin/DCN/local/lib/python2.7/site-packages/mimir/logger.py", line 71, in Logger
handlers.append(GzipJSONHandler(root))
File "/home/oisin/DCN/local/lib/python2.7/site-packages/mimir/handlers.py", line 134, in __init__
stream = gzlog.GZipLog(filename)
File "gzlog/gzlog.pyx", line 89, in mimir.gzlog.GZipLog.__init__
File "gzlog/gzlog.pyx", line 26, in mimir.gzlog.Gzlog.__cinit__
IOError
which I have been unable to resolve. Any help at all in trying to fix this would be greatly appreciated!
Frequently the lock is not removed on the keyboard interrupt. It seems that it doesn't cleanup sometime, but I cannot reproduce this with a simple script.
As far as I can see the log should be closed here. Is it possible that it is closed but still locked for some reason?
I wasn't able to install Mimir using python 2.7. The first problem was that there are unicode characters in setup.py
which can be easily fixed by a magical comment. Another problem that there's no collections.abc
in python 2.7 and I'm not sure how to fix it.
I guess I‘ve installed mimir correctly,like this:
adding 'mimir/init.py'
adding 'mimir/formatters.py'
adding 'mimir/gzlog.so'
adding 'mimir/handlers.py'
adding 'mimir/logger.py'
adding 'mimir/plot.py'
adding 'mimir/remote.py'
adding 'mimir/serialization.py'
adding 'mimir/stream.py'
adding 'mimir/utils.py'
adding 'mimir-0.1.dev1.dist-info/LICENSE'
adding 'mimir-0.1.dev1.dist-info/METADATA'
adding 'mimir-0.1.dev1.dist-info/WHEEL'
adding 'mimir-0.1.dev1.dist-info/top_level.txt'
adding 'mimir-0.1.dev1.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel
and I have ran the .whl file
but when I use mimir to run a program, it goes wrong
File "/home/mrbing/anaconda3/envs/keras_theano/lib/python2.7/site-packages/mimir/logger.py", line 71, in Logger
handlers.append(GzipJSONHandler(root))
File "/home/mrbing/anaconda3/envs/keras_theano/lib/python2.7/site-packages/mimir/handlers.py", line 134, in init
stream = gzlog.GZipLog(filename)
File "gzlog/gzlog.pyx", line 89, in mimir.gzlog.GZipLog.init
File "gzlog/gzlog.pyx", line 26, in mimir.gzlog.Gzlog.cinit
IOError
I dont kown why this happens, can u give me some suggestions?
Thx a lot
Gives the following error: error: unknown file type '.pyx' (from 'gzlog/gzlog.pyx')
. The full log is below:
╰─$ pip install --user .
Processing /home/rizar/Dist/mimir
Requirement already satisfied (use --upgrade to upgrade): pyzmq in /home/rizar/.local/lib/python2.7/site-packages (from mimir==0.1.dev1)
Requirement already satisfied (use --upgrade to upgrade): six in /home/rizar/.local/lib/python2.7/site-packages (from mimir==0.1.dev1)
Requirement already satisfied (use --upgrade to upgrade): simplejson in /usr/lib/python2.7/dist-packages (from mimir==0.1.dev1)
Installing collected packages: mimir
Running setup.py install for mimir
Complete output from command /usr/bin/python -c "import setuptools, tokenize;__file__='/tmp/pip-ybA77E-build/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-nHIRCH-record/install-record.txt --single-version-externally-managed --compile --user --prefix=:
running install
running build
running build_py
creating build
creating build/lib.linux-x86_64-2.7
creating build/lib.linux-x86_64-2.7/mimir
copying mimir/plot.py -> build/lib.linux-x86_64-2.7/mimir
copying mimir/formatters.py -> build/lib.linux-x86_64-2.7/mimir
copying mimir/utils.py -> build/lib.linux-x86_64-2.7/mimir
copying mimir/remote.py -> build/lib.linux-x86_64-2.7/mimir
copying mimir/serialization.py -> build/lib.linux-x86_64-2.7/mimir
copying mimir/logger.py -> build/lib.linux-x86_64-2.7/mimir
copying mimir/handlers.py -> build/lib.linux-x86_64-2.7/mimir
copying mimir/__init__.py -> build/lib.linux-x86_64-2.7/mimir
copying mimir/stream.py -> build/lib.linux-x86_64-2.7/mimir
running build_ext
building 'mimir.gzlog' extension
error: unknown file type '.pyx' (from 'gzlog/gzlog.pyx')
----------------------------------------
Command "/usr/bin/python -c "import setuptools, tokenize;__file__='/tmp/pip-ybA77E-build/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-nHIRCH-record/install-record.txt --single-version-externally-managed --compile --user --prefix=" failed with error code 1 in /tmp/pip-ybA77E-build
/home/rizar/.local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
InsecurePlatformWarning
You are using pip version 7.1.2, however version 8.0.3 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
As mentioned by @dmitriy-serdyuk in #1 (comment) the GzipJSONHandler
and PrintHandler
objects aren't picklable in Python 2 (GzipJSONHandler
seems fine in Python 3).
This is of course expected behaviour because pickling objects like file handles doesn't make sense most of the time, but we might need to come up with something to make Blocks' checkpointing happy.
I don't like the idea of adding all sorts of pickling magic just to accommodate Blocks, but maybe something can be done from the Blocks side instead.
When I try to run pip install git+git://github.com/bartvm/mimir.git
I get the error:
Collecting git+git://github.com/bartvm/mimir.git
Cloning git://github.com/bartvm/mimir.git to /tmp/pip-6C09DZ-build
Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-6C09DZ-build/setup.py", line 14, in <module>
long_description=readme(),
File "/tmp/pip-6C09DZ-build/setup.py", line 8, in readme
return f.read()
File "/usr/lib/python2.7/encodings/ascii.py", line 26, in decode
return codecs.ascii_decode(input, self.errors)[0]
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 1: ordinal not in range(128)
Any idea how to fix this?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.