lilongxian / baiyang-chatglm2-6b Goto Github PK
View Code? Open in Web Editor NEW(1)弹性区间标准化的旋转位置词嵌入编码器+peft LORA量化训练,提高万级tokens性能支持。(2)证据理论解释学习,提升模型的复杂逻辑推理能力(3)兼容alpaca数据格式。
(1)弹性区间标准化的旋转位置词嵌入编码器+peft LORA量化训练,提高万级tokens性能支持。(2)证据理论解释学习,提升模型的复杂逻辑推理能力(3)兼容alpaca数据格式。
请问怎么在windows/cpu下微调啊,我用ChatGLB2-6B官方的train教程去微调总是报各种错误
我想请教一下大佬,如果要对chatglm2做增量训练的话,数据组织是什么样的?数据的preprocess方法与目前sft相比 有哪些改动?大佬能否写一个预训练的脚本 想学习一下?
build_inputs_with_special_tokensa 方法不是返回 [gMASK], sentence1 sentenc2吗?
怎么会返回您说的chatGLM2:input_ids 为 “c + t”: a1,a2,...an,[gMASK], b1,b2,...bn,呢?
博主 你好!
我在chatglm2-6b的issue区看到了你的精彩评论,
请问ptuning微调后出现大量重复的问题你有解决吗。
如题。
我现在用的是langchain加载的chatglm2,请教下langchain-ChatGLM怎么加载训练好的模型
如题
Dear BaiYang-chatGLM2-6B developer,
我是 InternLM 社区开发者&志愿者尖米, 大佬开源的工作对我的启发很大,希望可以探讨使用 InternLM 实现 BaiYang-chatGLM2-6B 的可能性和实现路径,我的微信是 mzm312,希望可以取得联系进行更深度的交流;
Best regards,
尖米
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.