Comments (4)
Well, that went badly. I indexed a directory with a few thousand JSON files (campaign finance data) like such:
find *.json -exec curl -XPOST http://localhost:9200/finance/{} -d @{} \;
At first the files were loaded very rapidly, and it gradually got slower and slower, until finally it started returning this in response to each submission:
{"error":"OutOfMemoryError[Java heap space]","status":500}
from richmondsunlight.com.
I think I misunderstand the URL structure. I figured that http://localhost:9200/finance/1.json
was telling ElasticSearch "I want an index named 'finance'`, and within it I want to store a document named '1.json'." I think it's a bit more complicated than that.
from richmondsunlight.com.
Yeah, I think it was basically creating a new type of index with every post. I wouldn't swear to that. Anyhow, I'm trying this now:
find *.json -exec curl -XPOST http://localhost:9200/richmondsunlight/finance/{} -d @{} \;
from richmondsunlight.com.
Ah, yes. That worked much better.
ElasticSearch is, indeed, installed.
from richmondsunlight.com.
Related Issues (20)
- Menu kerning changes on hover
- Legislator lookup function is broken (again) HOT 1
- Fix admin tag-deletion functionality HOT 2
- Create an automated process to consolidate accounts
- Handful of IPs are racking up huge numbers of views HOT 2
- Install phpMyAdmin via Composer
- Move over Progress VA videos from old S3 bucket
- Deal with duplicate video records
- Ensure that retrieved video will always be embedded
- Legislators' coordinates are reversed
- Redo login form
- Update admin video section for SQS-based system
- Display legislators' bill notes on the bill pages HOT 2
- Support browser geolocation for legislator lookup HOT 1
- Save snapshots of LIS bulk data HOT 1
- Figure out why votes are not being exported as test data HOT 3
- Switch from raster to vector map tiles on legislator pages HOT 1
- Move back to storing sessions in Redis
- Consider adding instant.page
- Move away from Travis HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from richmondsunlight.com.