Giter VIP home page Giter VIP logo

ai-in-a-box's Introduction

AI-in-a-Box

FTA AI-in-a-Box: Deployment Accelerator

Embarking on an Azure AI/ML journey can appear challenging for certain organizations and engineers, often leading to roadblocks in their initial scenarios. To address this challenge, providing a user-friendly and intuitive template becomes crucial. Such a template should serve as a guiding example, illustrating the complete AI/ML/LLM lifecycle, showcasing the integration of MLOps practices, detailing the setup of training pipelines, offering insights into the processes of model training, deployment, access control, and integration with other services. This ensures a smoother and more comprehensible transition into the world of Azure AI and ML.

AI-in-a-Box aims to provide an "Azure AI/ML Easy Button" for common scenarios within Azure ML, Edge AI, Cog Services and Azure OpenAI. Something that shows you how the pieces fit together in easy to deploy templates. Using the patterns available here, engineers will be able to quickly setup an Azure ML/AI Edge/Cog Services and/or Azure Open AI environment which optionally includes data ingestion, model training and creation, scaling patterns and edge deployments. So, if you’re seeking to shed some light into the realm of Azure ML/AI and Open AI, you’ve come to the right spot.

FTA AI-in-a-Box: Deployment Accelerator

Available Guidance

Topic Description
Responsible AI This provides essential guidance on the responsible use of AI and LLM technologies.
Security for Generative AI Applications This document provides specific security guidance for Generative AI (GenAI) applications.

Available Patterns

Pattern Description Supported Use Cases and Features
Azure ML Operationalization in-a-box Boilerplate Data Science project from model development to deployment and monitoring
  • End-to-end MLOps project template
  • Outer Loop (infrastructure setup)
  • Inner Loop (model creation and deployment lifecycle)
  • Edge AI in-a-box Edge AI from model creation to deployment on Edge Device(s)
  • Create a model and deploy to Edge Device
  • Outer Loop Infrastructure Setup (IoT Hub, IoT Edge, Edge VM, Container Registry, Azure ML)
  • Inner Loop (model creation and deployment)
  • Doc Intelligence in-a-box This accelerator enables companies to automate PDF form processing, modernize operations, save time, and cut costs as part of their digital transformation journey.
  • Receive PDF Forms
  • Function App and Logic App for Orchestration
  • Document Intelligence Model creation for form processing and content extraction
  • Saves PDF data in Azure Cosmos DB
  • Video Analysis-Azure Open AI in-a-box Extracts information about videos by ingesting them into an Azure Computer Vision Video Retrieval index and sending the index to Azure GPT-4 Turbo with Vision along with the prompt and system message.
  • Orchestration through Azure Data Factory
  • Low code solution, easily extensible for your own use cases through ADF parameters
  • Reuse same solution and deployed resources for many different scenarios
  • Saves GPT4-V results to Azure CosmosDB
  • Cognitive Services Landing Zone in-a-box Minimal enterprise-ready networking and AI Services setup to support most Cognitive Services scenarios in a secure environment
  • Hub-and-Spoke Vnet setup and peering
  • Cognitive Service deployment
  • Private Endpoint setup
  • Private DNS integration with PaaS DNS resolver
  • Semantic Kernel Bot in-a-box Extendable solution accelerator for advanced Azure OpenAI Bots
  • Deploy Azure OpenAI bot to multiple channels (Web, Teams, Slack, etc)
  • Built-in Retrieval-Augmented Generation (RAG) support
  • Implement custom AI Plugins
  • NLP to SQL in-a-box Unleash the power of a cutting-edge speech-enabled SQL query system with Azure Open AI, Semantic Kernel, and Azure Speech Services. Simply speak your data requests in natural language, and let the magic happen.
  • Allows users to verbally express natural language queries
  • Translate into SQL statements using Azure Speech & AOAI
  • Execute on an Azure SQL DB
  • Assistants API in-a-box Harnessing the simplicity of the Assistants API, developers can seamlessly integrate assistants with diverse functionalities, from executing code to retrieving data, empowering users with versatile and dynamic digital assistants tailored to their needs.
  • Offers three main capabilities: Code Interpreter (tech tasks), Retrieval (finding info), and Function calling (task execution)
  • These powers combine to form a versatile super-assistant for handling diverse tasks
  • Assistants API Bot in-a-box This sample provides a step-by-step guide on how to deploy a virtual assistant leveraging the Azure OpenAI Assistants API. It covers the infrastructure deployment, configuration on the AI Studio and Azure Portal, and end-to-end testing examples.
  • Deploy the necessary infrastructure to support an Azure OpenAI Assistant
  • Configure as Assistant with the required tools
  • Connect a Bot Framework application to your Assistant to deploy the chat to multiple channels
  • Key Contacts & Contributors

    If you have any questions or would like to contribute please reach out to: [email protected]

    Contact GitHub ID Email
    Alex Morales @msalemor [email protected]
    Andre Dewes @andredewes [email protected]
    Andrés Padilla @AndresPad [email protected]
    Chris Ayers @codebytes [email protected]
    Eduardo Noriega @EduardoN [email protected]
    Jean Hayes @jehayesms [email protected]
    Marco Aurélio Bigélli Cardoso @MarcoABCardoso [email protected]
    Maria Vrabie @MariaVrabie [email protected]
    Neeraj Jhaveri @neerajjhaveri [email protected]
    Thiago Rotta @rottathiago [email protected]
    Victor Santana @Welasco [email protected]
    Sabyasachi Samaddar @ssamadda [email protected]

    ai-in-a-box's People

    Contributors

    andrespad avatar marcoabcardoso avatar paul-singh avatar welasco avatar codebytes avatar jehayesms avatar kbaroni avatar microsoftopensource avatar saby007 avatar neerajjhaveri avatar eduardon avatar olivmertens avatar

    Recommend Projects

    • React photo React

      A declarative, efficient, and flexible JavaScript library for building user interfaces.

    • Vue.js photo Vue.js

      🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

    • Typescript photo Typescript

      TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

    • TensorFlow photo TensorFlow

      An Open Source Machine Learning Framework for Everyone

    • Django photo Django

      The Web framework for perfectionists with deadlines.

    • D3 photo D3

      Bring data to life with SVG, Canvas and HTML. 📊📈🎉

    Recommend Topics

    • javascript

      JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

    • web

      Some thing interesting about web. New door for the world.

    • server

      A server is a program made to process requests and deliver data to clients.

    • Machine learning

      Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

    • Game

      Some thing interesting about game, make everyone happy.

    Recommend Org

    • Facebook photo Facebook

      We are working to build community through open source technology. NB: members must have two-factor auth.

    • Microsoft photo Microsoft

      Open source projects and samples from Microsoft.

    • Google photo Google

      Google ❤️ Open Source for everyone.

    • D3 photo D3

      Data-Driven Documents codes.