Giter VIP home page Giter VIP logo

internlm / lmdeploy Goto Github PK

View Code? Open in Web Editor NEW
2.8K 27.0 246.0 3.8 MB

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Home Page: https://lmdeploy.readthedocs.io/en/latest/

License: Apache License 2.0

Python 43.97% Shell 0.32% CMake 1.46% Cuda 18.75% C++ 35.43% C 0.04% Dockerfile 0.03% PowerShell 0.01%
cuda-kernels deepspeed fastertransformer llm-inference turbomind internlm llama llm codellama llama2

lmdeploy's People

Contributors

aisensiy avatar akhoroshev avatar allentdan avatar del-zhenwu avatar grimoire avatar harold-lkk avatar hit-cwh avatar hscspring avatar irexyc avatar ispobock avatar jjjjohnson avatar kevinnunu avatar lvhan028 avatar lzhangzz avatar lzhgrla avatar maxchiron avatar pppppm avatar runningleon avatar streamsunshine avatar tpoisonooo avatar uzuku avatar vansin avatar vody-am avatar wangruohui avatar wykvictor avatar xin-li-67 avatar yinfan98 avatar yunzhongyan0 avatar zhulinjulia24 avatar zhyncs avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Forkers

grimoire runningleon lzhangzz wangruohui ajinkyapuar zhangjun aptsunny tpoisonooo deftruth ajay-wong coderchem lvhan028 hanrui1sensetime chenzb0712 marsbzp del-zhenwu apx103 allentdan assassindesign kevinnunu rollroll90 humu789 streamsunshine skyrookieyu techsuni2023 varuy322 irexyc adai-5090 mygit-2023 ipackhu kunlun-zhu zimix0 vansin hanzz2007 lkjacky lzhgrla braintaken ludoplex harold-lkk feiyunwill gzl11 sundogs8603 amarone tianhaofu mworldstudio2023 zwh821 abbasns huangyingting camenduru hudengjunai huangongshu switiz87 jimmyma99 jjhw asdlei99 zigzagcai felixgithub2017 changdaxia-pts cdm1619 sleepwalker2017 nicolasf felixstander yihaocs hzzhang-nlp birdhaihe pdtgct iongpt sam2332 mauridev777 jianantian pangsg jack1981 wangxingjun778 alwaysssssss ksksks2222 yoctohan woolenwang 9tong mikejin5c scv119 akhoroshev jiajiajia789 eltociear aisensiy spongezz huxiangkun c1rn09 genggui001 mqlww shahrukhx01 opendilab-llm-safety mokeyish open-mmlab-12 hit-cwh shshenhao yunzhongyan0 kevin-14 yaospacetim zhcharles pppppm

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.