Giter VIP home page Giter VIP logo

StarRing's Projects

agentschainer-alm icon agentschainer-alm

由RWKV\Fay\Wenda等多方联合打造的一体型高度拟人心智化的智能体工程，拥有与生物智能相似的脑神经科学结构原理机制与学习认知规律，同时是一款可用于研究各种人体或类人体行为及心理的模拟器，当前版本为ALM版，即Automatic learning machine

chatgptx-uni icon chatgptx-uni

实现一种多Lora权值集成切换+Zero-Finetune零微调增强的跨模型技术方案，LLM-Base+LLM-X+Alpaca，初期，LLM-Base为Chatglm6B底座模型，LLM-X是LLAMA增强模型。该方案简易高效，目标是使此类语言模型能够低能耗广泛部署，并最终在小模型的基座上发生“智能涌现”，力图最小计算代价达成ChatGPT、GPT4、ChatRWKV等人类友好亲和效果。当前可以满足总结、提问、问答、摘要、改写、评论、扮演等各种需求。

dlip-rwkv icon dlip-rwkv

一种基于Clip改进的，通用HF格式的冻结LLM语言模型进行图文对齐的方案，以RWKV-4-World-0.4B的LLM模型为例，Cifar10为数据集。

hf-for-rwkvworld-loraalpaca icon hf-for-rwkvworld-loraalpaca

将RWKV World/World-CHN系列模型由原生pth转为HF格式，并进行基于peft库的Lora增量微调+Alpaca全量微调。

milu-gpt icon milu-gpt

麋鹿（MiLu），基于GPT2+BERT的语言模型，以少量的纯中文语料从头训练，验证小模型在ChatGPT类似友好能力

minirwkv-4 icon minirwkv-4

实现Blip2RWKV+QFormer的多模态图文对话大模型，使用Two-Step Cognitive Psychology Prompt方法，仅3B参数的模型便能够出现类人因果思维链。对标MiniGPT-4，ImageBind等图文对话大语言模型，力求以更小的算力和资源实现更好的智能效果。

multimodal-next-web icon multimodal-next-web

一键拥有你自己的跨平台 多模态上传文档+文本+语音ChatGPT 应用，支持PC/移动/平板等诸多平台。

ringrwkv icon ringrwkv

修复Transformer官方库中RWKV的适配问题，支持RWKV所有系列模型在转换后，通过RingRWKV库，与其他transfomer模型一样简单方便地部署和微调。

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.