accept incomplete json about jq HOT 4 CLOSED

Maybe --stream in combination with setpath could be used? something like this:

$ echo '{"a": [1,2,{"c":123},"b":767' | jq --stream | jq -n 'reduce inputs as $i ({}; if ($i | has(1)) then setpath($i[0]; $i[1]) else . end)'
parse error: ':' not as part of an object at line 1, column 25
{
  "a": [
    1,
    2,
    {
      "c": 123
    }
  ]
}

I tried to use fromstream but could not get it to work with a "broken" stream.

from jq.

I don't think I'll be doing this. It seems really specific to your log format. Generally, when the input makes no sense, I want to tell the user that the input makes no sense, rather than picking some meaning at random and running with it. Down that road lies PHP.

For your particular problem, have you considered just fixing it with sed before you pipe to jq? `sed 's/^[//;s/,$//' will delete '[' at the start of a line and commas at the end, which should leave you with one object per line (a format jq understands).

Incidentally, one JSON object per line with no other structure is a pretty sensible format: most languages have readline() and parseJSON(), and the format stays valid when cat'd, grep'd or logrotate'd.

from jq.

I think adding partial parsing support for truncated json would be valuable, sometimes you get some and it would be really good to be able to use jq to inspect it. This could be only enabled via an option, so normally it should of course fail when invalid json is parsed.

from jq.

Oh, that workaround is already something! Nice!

from jq.