Re: TOML performance about libconfini HOT 2 OPEN

@arp242

Thank you for pointing that out. I can write a paragraph about it in the next days (but I am not sure I will have time before mid October).

I also don't know how this compares to the 50M test-file you used (the TOML file lacks comments and is more "dense" in syntax than the big_file.ini that your script generates, so it's probably not a fair comparison).

If I don't remember wrong, I used the INI file generated by dev/tests/performance/prepare.sh (you will need to clone the repository before launching that script). Maybe you could re-post the timings you get using this file?

--madmurphy

from libconfini.

I can write a paragraph about it in the next days (but I am not sure I will have time before mid October).

No hurries; I came across this almost 2 weeks ago. I also hope to fix the worst of the issue in tomlc99 when I have the time (not my code, so not entirely sure how hard it is).

Maybe you could re-post the timings you get using this file?

That file doesn't produce valid TOML. A few weeks ago I looked in to it and manually fixed some obvious things, but then you run in to:

% tomlv ./big_file.ini
Error in './big_file.ini': toml: line 35: Key 'section' has already been defined.

So this needs more work.

I wrote a little script to frob with TOML table and key names and generated my 50M TOML file with that, but you need a "real" parser for this (can't just s/../../ it), and this won't output comments, so hard to really reproduce that big_file.ini in a way that's valid TOML at the moment.

tomlc99 also can't parse it, which is why you got the error. I wouldn't be surprised if all of those 13 minutes you spent waiting was just for the allocation, and it didn't actually parse anything.

from libconfini.