Giter VIP home page Giter VIP logo

meetsy-backend's Introduction

Meetsy: AI Meeting Assistant

Meetsy is a meeting assistant that transcribes, summarizes, extracts actions items from meetings and also makes it all searchable so you don't have to go through the whole meeting again to find that one thing you were looking for.

This repository contains the code for the AI backend of the project. The frontend can be found here and the demo can be found here.

Setup

Whisper API

The app uses the CellStrat Whisper API to transcribe the meetings. You can sign up for a free account here. Once you have an account, you can get your API key from the deployment dashboard.

Insights API

The Insights API is responsible for the Meeting Summarization and Action Item Extraction. Both of these tasks use the GPT-3 API from OpenAI. This part is setup as a lambda function on AWS for additional post processing. You can find the code for the lambda function here and the lambda layer setup for the openai package here.

Instructions

  1. Follow the instructions in the lambda_layer's readme to setup the lambda layer.
  2. Create a new lambda function on AWS with the following settings:
    • Runtime: Python 3.8
    • Handler: lambda_function.lambda_handler
    • Layers: The lambda layer you created in step 1.
    • Environment Variables
      • OPENAI_API_KEY: Your OpenAI API key
  3. Copy the code in insights_api folder to the lambda function.
  4. Create a Lambda Function URL to invoke the lambda function from the frontend. Make sure to apply the appropriate CORS settings and authentication to None.
  5. Don't forget to increase the timeout of the lambda function to 2 minutes or something similar.

Search API

The search API works on the transcript of the meeting to find the relevant timestamps for the search query. It uses Sentence Transformers to find the most similar sentences to the search query. This model is deployed on CellStrat Hub as well who's code can be found at transcript_search.

Instructions

  1. Open your workspace on CellStrat Hub and upload the transcript_search folder.
  2. Open up a terminal and run the following commands as a pre-requisite to install the required packages:
    cd transcript_search
    pip install sentence-transformers
    python download_model.py
  3. Now build and deploy the model using the following commands:
    hub build
    hub deploy

Learn more about deploying models on CellStrat Hub here.

meetsy-backend's People

Contributors

nerdimite avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.