[Bug] llama2 7b android compilation is giving "Can only handle constant size stack allocation for now" error about mlc-llm HOT 3 CLOSED

I am not sure what was happening on this case, perhaps it is related to come stale variant of compiler. we recently updated our android SDK https://llm.mlc.ai/docs/deploy/android.html please try follow the new instructions

from mlc-llm.

This is not just happening on the Android SDK, I am using this on a CUDA device, but this error still happens. I tried to use a built from source mlc_llm, the error would happen, but when I use the pre-built the mlc_llm, this error goes away. It is hard to locate where is the problem, can anyone give more hints @tqchen?

In my case, I already installed a pre-built mlc_llm & tvm-unity package in my environment, then I git clone the newest version of mlc_llm, and created a virtual environment, then built it from source, I tested a Qwen2-0.5B model with these these 2 versions of mlc_llm

mlc-ai-nightly-cu122      0.15.dev297
mlc_llm                   0.1.dev1231+gbc6e3edd /xxx/mlc-llm/python
mlc-llm-nightly-cu122     0.1.dev1145

--------------- Update ----------------
This is solved when I upgrade my tvm version to the latest pre-built package

mlc-ai-nightly-cu122      0.15.dev364

I guess the mlc_llm & tvm are closely tangled, there are some mismatch bewteen new version of mlc and old version of tvm

from mlc-llm.

Glad this is resolved. likely it was due to old ersion of the tvm

from mlc-llm.