Giter VIP home page Giter VIP logo

twigator_project's Introduction

twigator project - twitter aggregator project

Build Status Code Climate Test Coverage Issue Count

Description

Twigator project is a twitter message aggregator that searches messages periodically (using Twitter Search API) stores them in database (MongoDB) and exposes RESTFul API for queries.

Privacy notice

This project is created purely for educational purposes as a hands-on exercise using Twython, MongoEngine and MongoDB aggregations. Please respect privacy of the others if you're going to use it.

Installation

This project requires Docker, Docker Compose and make for most use cases.

Configuration

Configuration is done via environment variables on host system. The list is as follows:

  • TWITTER_CONSUMER_KEY
  • TWITTER_CONSUMER_SECRET
  • TWEET_LAST_TWEETS - amount of new tweets to ingest
  • TWEET_EVERY_MINUTES - parse tweets every X minutes (at least 1)
  • TWEET_QUERY - search criteria

Usage

To get familiar with the project, start by typing: make After few moments HTTP API will be available at http://localhost:8000

To stop containers, type: make stop

Endpoints

To get all values for URLs with queries provide "" or '' as query, e.g.

http://localhost:8000/tweets/''

Queries:

Aggregations:

Development

Running tests

Following test group are ran every time tests target is requested:

  • PyLint
  • MyPy
  • Unit tests
  • Unit tests + Coverage

Command to run all test groups:

make tests

API documentation

API documentation is available after running make at:

twigator_project's People

Contributors

tb0hdan avatar

Stargazers

 avatar

Watchers

 avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.