Giter VIP home page Giter VIP logo

gpu_camp24's Introduction

AEEE-Summer School GPU Camp

This is a repository to deliver the 2024 GPU Camp Training Material on Aug 6-8, 2024. Please DO NOT distribute this document for any commercial purposes.

Agenda

Date Time Activity Resource
6-Aug 9:30-10:30 AMD AI Solution and Radeon GPU AI demo, Training with ROCm/Pytorch
10:30-11:30 Deploy LLM and RAG with Radeon GPU Play with rocm; Deploy LLM with ollama
14:00-17:00 Design your own AI Agent with Infini-AI Infini AI
7-Aug 9:30-10:30 ROCm and HIP from scratch
10:30-11:30 HIP program model; Structure of HIP code; HIP error checking; Timing HIP codes Shared memory; CUDA-to-HIP translations; HIP program model; HIP documentation;
14:00-17:00 Lab Time RAG notebooks; ROCm/HIP notebooks
8-Aug 9:30-10:30 Case study: Optimize the LLM on Radeon GPU with HIP
10:30-11:30 CCF-CCC challenge Winner Sharing, LLM Optimization CCF challenge; How to profile a HIP program
14:00-16:00 Lab Time RAG notebooks; ROCm/HIP notebooks
16:00-17:00 Home Work

Remote Lab Access

You can follow the steps below to access to our remote lab:

  1. Open your browser and type http://111.229.117.44:8991/signin/ to login in. If you have not registered yet, choose "sign up here" to register your account.
  2. Choose NUS-GPU Access. Login in with your access token. avater
  3. Enter the jupyter hub with your link and password. avater
  4. Choose "AMD GPU" for Lab1 and "RAG" for Lab2. avater
  5. Start playing.

Homework

Lab1: HIP programing introduction

In this lab, we will not only delve deeply into the programming techniques of AMD GPUs, but also guide you through practice to master the AMD GPU programming model HIP (Heterogeneous-Compute Interface for Portability). Our goal is to start from the basic concepts, gradually build a profound understanding of HIP program development, and ultimately enable you to independently write and run your own HIP programs.

Homeworks

Finish the exercises in [exercises].

Lab2: A simple RAG system

In this lab, we will explore how to use LLMs to transform documents into knowledge and build your own local knowledge base. You will learn how to construct a local knowledge base and how to gradually build a simple RAG (Retrieval-Augmentation Generation) system, which can generate question-and-answer responses based on local documents, making the LLMs generate more trustful content.

Homeworks

  1. Change the query prompt in Step 3. Build RAG chain to make the llm RAG system response in json format.
  2. Replace the the input documentation in Step 2. Indexing your file with your own documentation;
  3. (Adavanced) Is there a better way to improve the performance of RAG system ?

Submission

  • Deadline: 18th Aug
  • Submission format:
    • Download the Jupyter Notebook and send the notebook file through e-mail.
  • E-mail Notification: [email protected]
    • Name, School, Cell Phone number should be provided in the e-mail.

Addition meterial

[Langchain]
[ROCm documentation]
[HIP documentation]
[PowerInfer]
[ollama]
[Infini AI]
[GPU CAMP Remote LAB]

gpu_camp24's People

Contributors

tworan avatar vickyiii avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.