Install ElasticSearch about richmondsunlight.com HOT 4 CLOSED

Well, that went badly. I indexed a directory with a few thousand JSON files (campaign finance data) like such:

find *.json -exec curl -XPOST http://localhost:9200/finance/{} -d @{} \;

At first the files were loaded very rapidly, and it gradually got slower and slower, until finally it started returning this in response to each submission:

{"error":"OutOfMemoryError[Java heap space]","status":500}

from richmondsunlight.com.

I think I misunderstand the URL structure. I figured that http://localhost:9200/finance/1.json was telling ElasticSearch "I want an index named 'finance'`, and within it I want to store a document named '1.json'." I think it's a bit more complicated than that.

from richmondsunlight.com.

Yeah, I think it was basically creating a new type of index with every post. I wouldn't swear to that. Anyhow, I'm trying this now:

find *.json -exec curl -XPOST http://localhost:9200/richmondsunlight/finance/{} -d @{} \;

from richmondsunlight.com.

Ah, yes. That worked much better.

ElasticSearch is, indeed, installed.

from richmondsunlight.com.