Giter VIP home page Giter VIP logo

news-service's Introduction

image

News Service

This sample application performs news article scraping with advanced classification and summarization capabilities. The application fetches article URLs from RSS feeds by polling various news outlets and maintains a cache of discovered URLs. It leverages OpenAI's ChatGPT-4o to categorize each article according to a specific Greek municipality. After categorization, the application generates a concise summary of the article.

The summaries are stored in Firebase for each municipality. The application uses Python for the scraper and NextJS for the frontend map. Additionally, it uses a Leaflet map to display emoji previews that capture the mood of the news, depending on the municipality area. These emojis provide a quick visual representation of the news sentiment within each region.

General notes

You can view a live demo at https://news.paravantis.org/.

  • To run this app, set up a Firebase project with Firestore
  • Use Docker to spin up a containerized version with docker compose up -d

Scraper setup

To run the Python scraper backend:

  • Create a virtual environment and install the dependencies with pip install -r requirements.txt
  • Install the scraper package locally for development with pip install -e .
  • Setup the required .env and firebase.json project files
  • Launch the scraper with python run_instant.py

Client setup

To run the NextJS frontend client:

  • Install the dependencies with npm install
  • Setup the required .env project files
  • Launch the development server with npm run start

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.