Comments (9)
Yes. WebAssembly is probably out for the time being, but a native node extension is something that ought to be done.
from simdjson.
In what size of json file we can expect the benefit? if that is known, I think it will switch in using this instead? but for me, as it is working best as a compiled binary..maybe a node script that Interface it using child_process is more suitable?
from simdjson.
Say we have a working Node binding to simdjson.
In the readme, it reads:
Performance is optimized for JSON documents spanning at least a few kilobytes up to many megabytes: the performance issues with having to parse many tiny JSON documents or one truly enormous JSON document are different.
Does this mean that, this library would not be a suitable replacement for JSON.parse(jsonstring)
in Node.js, where jsonstring is just a single line of JSON string?
from simdjson.
The issue is not resolved yet, why close then ?
from simdjson.
Does this mean that, this library would not be a suitable replacement for
JSON.parse(jsonstring)
in Node.js, where jsonstring is just a single line of JSON string?
If you are parsing a single line of JSON, then it is unlikely that the time spent parsing is significant enough to warrant optimization unless you are parsing many, many such cases. And at that point, things like function call overhead and memory allocations are likely to dominate your running time. This is potentially interesting, but it is not something that this library was optimized for.
from simdjson.
from simdjson.
const [isOnline, setIsOnline] = add(users, isOnline(friend.id));
from simdjson.
In what size of json file we can expect the benefit?
From the README: "Performance is optimized for JSON documents spanning at least a tens kilobytes up to many megabytes". This library (simdjson) is for processing large volumes of JSON.
from simdjson.
My statement above were deliberately pessimistic: simdjson does very well even on tiny documents. At the time I wrote the above comments, I had not benchmarked simdjson on tiny documents.
from simdjson.
Related Issues (20)
- Add full support for JSONPath HOT 19
- 你能训练一个连下2步的围棋ai吗?
- Trailing comma support for array and object HOT 1
- Confusing error message when trying to convert a non-scalar on-demand document to a value HOT 2
- Add Glace to the benchmarks HOT 1
- Double parsing can produce incorrect results due to integer overflow. HOT 1
- get_number().get_double() produces incorrect results, but get_double() is correct HOT 1
- unsafe precondition(s) violated: ptr::write requires that the pointer argument is aligned and non-null HOT 1
- [SOLVED] ambiguous template specialization 'get<simdjson::fallback::ondemand::document>' HOT 2
- How can I fix 'simdjson::dom::parser::Iterator::is_object': Use the new DOM navigation API instead (see doc/basics.md)' compiler warning in VS2019? HOT 1
- Implement an ability to parse integers that exceed 64 bits HOT 11
- Does this library only support the read operations? I have seen some APIs that do not seem to support the write operations similar to rapidjson. HOT 1
- Branchless integer parsing
- Wrong version number for release 3.7.0 HOT 9
- 3.6.4: build fails with gcc 14.x HOT 9
- Fallback parser missing on aarch64 + Linux HOT 7
- When capacity of padded_string_view is given a size smaller than length, padding() is wrapping HOT 2
- Security Policy HOT 2
- Fail to parse boolean in a truncated document stream. HOT 3
- Does simdjson get faster if you keep parsing objects with the same schema? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from simdjson.