Related Issues (20)
- is_deepspeed_available error for a dir happen to be called deepspeed HOT 5
- Encounter wired seg fault in max 1550 using BigDL-LLM for infernece.
- Starting from bigdl-llm[xpu]==2.5.0b20231227, the 32-32 output of gguf models on Arc770 contains <unk> HOT 2
- MTL Code-LLama-13B OOM issue
- MTL Code-LLama-13B System int4 之后无法停止
- How to install bigdl library from source code? HOT 7
- [Question]: How to use int8 API (nano or ggml?) in LLAMA inference? HOT 3
- how to use xpu to fine tuning bai chuan 13b model with lora method HOT 3
- Chatglm3-6B 自问自答 HOT 1
- Memory will up to 18GB when load low bit INT4 chatglm3-6B HOT 11
- No acceleration in example code on CPU HOT 4
- inference problem with baichuan 13b HOT 22
- Chatglm3-6B KV cache demo can't run on Arc A750 HOT 5
- Facing vulnerability issue with pyspark and ray version using bigdl-spark3==2.4.0 HOT 1
- Failed to run vllm offline_inference.py with "meta-llama/Llama-2-7b-chat-hf" HOT 6
- BigDL-LLM Container can't support Qwen-14B-Chat HOT 2
- Baichuan 2-13B Chat CPU utilization rate only 20% HOT 15
- The output of Qwen-14B-Chat has some question HOT 7
- Output of GGUF Mixtral model on SPR01 is incorrect HOT 1
- `RuntimeError: Last dim of input tensor must be multiple of 64` when loading CogAgent model HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bigdl.