Comments (4)
WARNING: lavapipe is not a conformant vulkan implementation, testing use only.
Seems that the Vulkan driver is not properly installed, because lavapipe is a CPU simulation of Vulkan
from mlc-llm.
I have the same issue.
My driver is :nvidia-driver-530 (530.41.03-0ubuntu0.20.04.2).
5.15.0-71-generic
The demo video also shows "WARNING: lavapipe is not a conformant vulkan implementation, testing use only.", so it might not be the issue.
from mlc-llm.
If you already have your NVIDIA driver installed, make sure your system is picking it up by setting the Vulkan ICD environment variable:
export VK_ICD_FILENAMES=/usr/share/vulkan/icd.d/nvidia_icd.json
If that's not solving your issue (it did for me), you probably already know that on some Linux distribution (Debian for instance), there is no support for NVIDIA GPUs, so you have to go through the setup. See here: https://phoenixnap.com/kb/nvidia-drivers-debian
I hope this helps. Once the Vulkan driver started to use my NVIDIA Tesla T4 on my VM, all went running fine.
from mlc-llm.
The demo video also shows "WARNING: lavapipe is not a conformant vulkan implementation, testing use only.", so it might not be the issue.
That's correct. lavapipe
is a CPU-simulated Vulkan implementation. If this message pops out, it probably means you might want to install a proper version of Vulkan
from mlc-llm.
Related Issues (20)
- [Bug] TVMError: Check failed: (result) is false: Failed to allocate 99121664 bytes with alignment 16 bytes
- AutoTVM optimization? HOT 3
- Phi-3-3.8 billion model [Model Request] HOT 2
- [Question] Omniquant. (AFAIK) scores best for Q. Methods, why no adoption? In any case, is per-tensor quant. best for Mixtral/MoE models? HOT 1
- [Bug] Error: could not compile `regex-syntax`
- [Bug] `mlc_llm chat` throws errors for model `mlc-ai/Qwen1.5-1.8B-Chat-q4f16_1-MLC`
- [Bug] `system-lib-prefix` would be cleared if `device` is not strictly `android` while `mlc_llm compile` HOT 2
- /opt/AI/llm_obj/mlc-llm/3rdparty/tvm/jvm/native/src/main/native/org_apache_tvm_native_c_api.cc:232:31: error: cannot initialize a parameter of type 'void **' with an rvalue of type 'JNIEnv **' (aka 'JNIEnv_ **') 232 | _jvm->AttachCurrentThread(&env, nullptr); | ^~~~ /usr/local/java/jdk-17.0.11/include/jni.h:1938:37: note: passing argument to parameter 'penv' here 1938 | jint AttachCurrentThread(void **penv, void *args) { | ^ /opt/AI/llm_obj/mlc-llm/3rdparty/tvm/jvm/native/src/main/native/org_apache_tvm_native_c_api.cc:309:31: error: cannot initialize a parameter of type 'void **' with an rvalue of type 'JNIEnv **' (aka 'JNIEnv_ **') HOT 2
- [Question] What models actually work with function calling?
- [Question] Using FP8 quantization on a RedPajama-INCITE-Chat-3B-v1 model HOT 2
- Phi-3 mini 4k instruct with MICROSOFT's quantization HOT 3
- Reduced and now seemingly removed support for Mali? HOT 5
- [Bug] Check failed: (args.size() == initial_indices_orig.size()) is false HOT 1
- [Bug] LlaMa-3 doesn't work HOT 5
- [Bug] llama2 7b android compilation is giving "Can only handle constant size stack allocation for now" error HOT 1
- Prebuilt StableLM 1.6B model compilation not working HOT 4
- [Model Request] can we get Aryanne/Calypso-3B-alpha-v2-gguf HOT 1
- [Bug] REST server doesn't work on V100 (SM70) - cudaErrorNoKernelImageForDevice (but chat works) HOT 16
- [Bug] mlc-llm not working, tvm check returns none HOT 24
- Android MLCChat failed ,[Bug] HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mlc-llm.