Related Issues (20)
- llama 3 can not load_low_bit HOT 2
- chatglm3-6b with fp8, 1k input, 512 output, and batch 64 failed by all-in-one benchmark tool
- Unable to run llama_cpp example from quickstart guide (PI_ERROR_BUILD_PROGRAM_FAILURE) HOT 1
- Llama-CPP Install Issue - Windows HOT 4
- [Feature Request] IPEX-LLM + Axolotl Docker Image HOT 24
- ollama no GPU - Intel Arc A750 Windows and Linux HOT 2
- [vLlm-serving] When run "VLLM_BUILD_XPU_OPS=1 pip install --no-build-isolation -v -e . ", it reports can't find dpct.hpp HOT 11
- [MTL][Qwen] model fail RuntimeError: "normal_kernel_cpu" not implemented for 'Byte' HOT 4
- How to use BigDL to calculate MSE values HOT 1
- qwen 1.5 error with intelanalytics/ipex-llm-xpu:2.1.0-SNAPSHOT HOT 2
- Update Ollama Version to 0.1.32 HOT 3
- SYCL error: CHECK_TRY_ERROR(dpct::gemm_batch( *g_sycl_handles[g_main_device], oneapi::mkl::transpose::trans HOT 10
- Running 2 x A770 with Ollama, inference responses slow down dramatically HOT 23
- wav2lip issue - Intel ARC on Ubuntu HOT 2
- GPU hang when switch between Llama2 and Llama3 on ARC770 HOT 1
- How to use BigDL to achieve early stop function HOT 1
- RuntimeError: "fused_dropout" not implemented for 'Byte' when running trl ppo finetuning HOT 3
- Can provide llama.dll build guide? HOT 2
- Issue with saving and loading low bit BLIP-2 model HOT 1
- Improve First Token Latency for multi-GPU projects (by flash attention or alternative)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bigdl.