Comments (1)
Just for anyone else that stumbles upon this issue, I just ran this script, and got the same results.
I only have 30 unique characters in my data set, so I get two None's (Pythons null identifier), at each of those internal arrays. I'm going to guess that you have 31 unique characters in your dataset.
Those values are never read. So, anything between INT8_MIN and INT8_MAX (-128 and 127 maybe) should work fine. Or, just delete those slots and they should work also. Null char would probably work. Or junk. But, the loop that reads those values does short circuit if the value is less than zero, so if for some reason they were read (they won't be), you would want them to be less than zero.
There's probably a bug in the Python script that is printing the null identifier ("None") instead of the null value ('\0').
Count the number of elements inside chrs_by_chr_id[32]. For me, there's space for 32, but only thirty characters in the array. The last two are missing, and the compression loop breaks when it gets the null value, so it never gets to the inner part to read what the null value is. So, no optimization can be done.
Still, the Python script could be fixed.
from shoco.
Related Issues (20)
- Buffer overflows on malformed input HOT 1
- Off-by-one error in shoco.c function: shoco_compress HOT 1
- Input string in compress must be null terminated even when len provided HOT 2
- Tag a release
- PHP extension
- JSON output for generate_successor_table.py HOT 1
- Unable to "make js" on Ubuntu
- global buffer overflow in shoco_decompress() HOT 1
- Does not work as a node.js module
- Cant compress some ASCII strings. HOT 1
- I am getting this error: Uncaught TypeError: $.stackSave is not a function
- TypeError: ord() expected string of length 1, but int found HOT 2
- TypeError: can't concat str to bytes HOT 1
- `make js` --> Error: Variable Module declared more than once. (and a `cwrap` error)
- What's the optimum minimum length of a string to consider using shoco?
- Model generator generates non-C compliant code
- python binding/wrapper needed.
- Compress tokenized strings
- Weissman Score for Short String Compression
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from shoco.