Segmentation Fault with 7b on Raspberry Pi 3 about alpaca.cpp HOT 5 OPEN

Same here, segmentation fault, but on an old Linux x86_64 elitebook laptop. In this case it was -mavx causing the error.
This compiles, but it runs pretty slow without mavx: ggerganov#107

gcc -I. -O3 -DNDEBUG -std=c11 -fPIC -pthread -msse3 -c ggml.c -o ggml.o
g++ -I. -I./examples -O3 -DNDEBUG -std=c++11 -fPIC -pthread chat.cpp ggml.o utils.o -o chat
g++ -I. -I./examples -O3 -DNDEBUG -std=c++11 -fPIC -pthread quantize.cpp ggml.o utils.o -o quantize

from alpaca.cpp.

same problem here. working with a aws ec2. having the problem even without building from source. The file size is 4.0GB? may be the problem...

from alpaca.cpp.

Hello, I also have the same issue with a Raspberry Pi 4, 4GB

I'm not sure the file size is the issue, as this blog got it working for a RPi 5 also with the same 4GB of RAM.

from alpaca.cpp.

Might want to trim down any running processes, also. Running non-graphical session, perhaps?

from alpaca.cpp.

Yeah so I run headless. I ended up using a 2-bit model instead that was 2+GB in size and it seemed to work.

from alpaca.cpp.