Missing --host parameter in deploy.sh for K8S type deployment using release docker image about serge HOT 5 CLOSED

I'm currently trying with the new image that has been published. I'll give you the answer in the following minutes.

from serge.

Newly pushed image returns an error in the chat (see below), building it locally and using it fixes the original issue and works.

main: seed = 1679851058
llama_model_load: loading model from '/usr/src/app/weights/ggml-alpaca-7B-q4_0.bin' - please wait ...
llama_model_load: n_vocab = 32000
llama_model_load: n_ctx   = 512
llama_model_load: n_embd  = 4096
llama_model_load: n_mult  = 256
llama_model_load: n_head  = 32
llama_model_load: n_layer = 32
llama_model_load: n_rot   = 128
llama_model_load: f16     = 2
llama_model_load: n_ff    = 11008
llama_model_load: n_parts = 1

from serge.

I have also provided the fix here (look for #71). It shouldn't impact other deployments. If this issue gets fixed, a new docker image can be built and pushed to the repository and it'll be deployable on Docker and K8S

from serge.

@FenarkSEC Can this be close now that #71 was merged?

from serge.

09471f2 have fixed the issue with the newly built image, issue can be closed.

from serge.