Comments (16)
Can you provide the line number and file the error is from.
from datacomets.
As I recall, it said parse:1
from datacomets.
So it's coming from the backend and likely means Pyulog is failing to read the file somehow. I'm not sure I can debug this one without the log file. Could you share it?
from datacomets.
Unfortunately I cannot share the particular log file. However, I might be able to find another one and test with that as well. I will also look into the parsing with python.
from datacomets.
I understand that no worries, if you can run the ulog2csv command it is most likely a network issue and not a issue with the log.
from datacomets.
It is definitely not an issue with the log. It doesn’t fail every time. If I try multiple times, it will succeed at some point.
from datacomets.
I see, definitely a network issue then, I am working on a javascript parser which would solve these issue but if it seems like it will take a lot of time I will invest more time into better netcode.
from datacomets.
The log is fine, if I try multiple times with the same log, eventually it will succeeed.
from datacomets.
With the larger logs i have noticed it can sometimes fail to send all the data to the python sever correctly. With a JavaScript parser that step is not necessary any more and there shouldn't be network failures since everything would happen on the client side.
from datacomets.
In the mean time, I could setup datacomets to accept pre-processed logs. This way for very large logs you can parse them separately with a quick python command and then load the log into data comets. This would also be faster for very large logs since you dont have to deal with the network. Less convenient but a stop gap for now, what do you think?
from datacomets.
Sounds great. Please let me know if I can be of any assistance.
from datacomets.
@dsaffo I missed the comment about preprocessed logs. How would I preprocess the logs then? It doesn't seem to be the "parsing" that fails, but the uploading. Which would still have to take place as the server is plotting?
Please correct me if I am wrong.
from datacomets.
Keep in mind, that when I say "local server", it is a server I started using your suggestion with gunicorn.
from datacomets.
from datacomets.
Actually after doing so more research I think I will try to implement this plugin instead https://github.com/blueimp/jQuery-File-Upload/blob/master/README.md#features. It features file chunking and progress bars so might get 2 for 1 solution here.
from datacomets.
@dsaffo That would definitely be the preferred solution.
from datacomets.
Related Issues (7)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from datacomets.