A collection of crawlers for news web sites. API is used to grab links of the latest stories and provide them in a clean json format to be rendered however you need. Most news orgs do not provide an api to get their latest stories, so I have created my own. Included is a simple index file for viewing the current api.

preview of index viewer

This api relies on node.js so make sure you have a revent version installed.

1. git clone https://github.com/OpenNewsLabs/spiders.git
2. cd spiders && npm install
3. node app.js
4. open up the index viewer of all the latest news at the local uri http://localhost/cnn

After local installation is running all apis below can be viewed by appending to base path. example: "http://localhost:3000/cnn"

• GET /cnn
• GET /fox
• GET /bbc
• GET /nyt

API tests are run using mocha. Before you run mocha you must have the API running ( step three under local installation )