Giter VIP home page Giter VIP logo

meow-ai's Introduction

Meow-AI

“Meow-AI”是基于RWKV的本地轻量级聊天AI

环境配置

推荐Python版本 3.9.18
需要模块numpy、tokenizers、prompt_toolkit、flask、flask-socketio、torch、subprocess
pip3 install numpy tokenizers prompt_toolkit flask flask-socketio torch subprocess

运行要求

最低4G运行内存(CPU+4G内存,可以运行430m的小模型)
最高不限(最高可运行14b的大模型,聊天质量和效果更加好)

运行设置

根据自己电脑配置在模型网站(https://huggingface.co/BlinkDL)下载合适的模型 (镜像网址) 下载的所有文件放在models文件夹内,并修改config.json中的“modelFile”,将'RWKV-x060-World-1B6-v2-20240208-ctx4096'修改为自己下载的模型名
运行main.py,在浏览器中打开http://172.0.0.1:5000 即可开始对话

功能更新

  • 2024-01-05:支持手动停止对话
  • 2024-01-19:支持编辑对话实现简单的手动微调
  • 2024-01-23:支持配置导入/导出,支持自定义AI性格人设
  • 2024-03-01:完全使用RWKV架构,实现更小的模型体积,降低运行内存和CPU占用
  • 2024-04-26:优化整体架构
  • 2024-07-08:支持扩展功能,支持微信自动聊天
  • 2024-07-21:完成一键懒人运行包

演示效果

1. 持续对话

该演示环境为GPU+8G,使用'RWKV-4-World-CHNtuned-0.1B-v1-20230617-ctx4096'模型
image

2. 手动调整对话

注:手动添加修改更多的自己预设的对话,对后续的实现自己想要的聊天效果有很大帮助
image

3. 配置导入导出

可以导入导出对话以及配置信息
image

4. 调教AI人设性格

可以自定义设置MeowAI人设性格,让MeowAI更加符合自己的喜好
image

5. 扩展功能

支持添加自定义扩展功能,目前已完成“微信自动聊天”
点击启动后,将自动打开微信,自动回复聊天
image

6. 一键懒人运行包

无需手动配置环境,运行包里含了所有所需环境,只需双击运行即可 (由于运行包大小过大,请在releases下载)
image

未来展望

  1. 完成更多功能扩展
  2. 待续……

Star History

Star History Chart

meow-ai's People

Contributors

bilibini avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar r00tk1t avatar suyuan avatar 网络安全军火库 avatar wumoumou avatar  avatar  avatar WhiteFan avatar Vito Jerde avatar Engineer avatar milu223 avatar  avatar Zhwt avatar  avatar  avatar  avatar gzh avatar Dai0v0 avatar  avatar ITJoker avatar  avatar  avatar  avatar  avatar it985 avatar zixing avatar AI-Compare avatar  avatar

Watchers

 avatar

meow-ai's Issues

readme中的链接有问题,直接点击的话会把 `https://huggingface.co/RWKV)下载合适的模型` 当作一个链接

readme中的链接有问题,直接点击的话会把 https://huggingface.co/RWKV)下载合适的模型 当作一个链接,markdown的链接格式如下

// [text](url)
根据自己电脑配置在模型网站([https://huggingface.co/RWKV](https://huggingface.co/RWKV))下载合适的模型  

效果:
// text
根据自己电脑配置在模型网站(https://huggingface.co/RWKV)下载合适的模型

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.