Docker Issus ''Illegal instruction'' #537
Description
I try to make it run the docker version on Unraid,
I run this as post Arguments:
--run -m /models/7B/ggml-model-q4_0.bin -p "This is a test" -n 512
I got this error: /app/.devops/tools.sh: line 40: 7 Illegal instruction ./main $arg2
Log:
main: seed = 1679843913
llama_model_load: loading model from '/models/7B/ggml-model-q4_0.bin' - please wait ...
llama_model_load: n_vocab = 32000
llama_model_load: n_ctx = 512
llama_model_load: n_embd = 4096
llama_model_load: n_mult = 256
llama_model_load: n_head = 32
llama_model_load: n_layer = 32
llama_model_load: n_rot = 128
llama_model_load: f16 = 2
llama_model_load: n_ff = 11008
llama_model_load: n_parts = 1
llama_model_load: type = 1
llama_model_load: ggml ctx size = 4273.34 MB
llama_model_load: mem required = 6065.34 MB (+ 1026.00 MB per state)
/app/.devops/tools.sh: line 40: 7 Illegal instruction ./main $arg2
I have run this whitout any issus: --all-in-one "/models/" 7B