Data files incorrectly formatted about kenyanigeriabuildingfootprints HOT 8 CLOSED

Python will take forever to parse a file that size. I'm sure there's a more elegant way to do this, but I used a BASH command from the terminal that completed in a relatively short time.

cat incorrect.geojsonl | cut -c 44- | sed 's/]}$//' > correct.geojsonl

Now can someone at Microsoft do this to all the files and upload them again, please?

from kenyanigeriabuildingfootprints.

I noticed a similar mistake @drStacky.

from kenyanigeriabuildingfootprints.

It seems GDAL only supports sequences of GeoJSON features (not feature collections). But the original dataset (data.njson) can be easily transformed to a proper one (output.njson):

import json
with open("data.njson", "rt") as src:
    with open("output.njson", "w") as dst:
        for row in src:
            fc = json.loads(row)
            for f in fc["features"]:
                json.dump(f, dst)
                dst.write("\n")

from kenyanigeriabuildingfootprints.

Thanks for notifying us. Both Kenya and Nigeria were updated today and can be found in the same locations.

from kenyanigeriabuildingfootprints.

+1 @drStacky @denironyx

from kenyanigeriabuildingfootprints.

I have a similar script that is currently taking forever to run.

Please how long does this script take you? @drnextgis

from kenyanigeriabuildingfootprints.

@drnextgis script is pretty good, kenya file takes around 30 min to run on a regular server, nigeria is longer, but overnight would be ok

it's a one time conversion after all

from kenyanigeriabuildingfootprints.

Yeah, it's a nice script. Nigeria took me about 1hr on 16gig ram windows 11 1TD SSD. Thanks @drStacky

from kenyanigeriabuildingfootprints.