Skip to content

Compile bug: [blas] choose blas backend to run llama2-7b model, but system info doesn't have the blas flag. #14259

Open
@YaoCheng-Chang

Description

@YaoCheng-Chang

Git commit

413977d

Operating systems

Linux

GGML backends

BLAS

Problem description & steps to reproduce

First, I followed the blas backend doc to cmake the llama.cpp.
I found that there truely have found the blas library.

Image

And also built the blas target in cmake.

Image

However, when I tried to run the llama2-7b model, the system info doesn't have the blas info.
And the backend is used the CPU.

Image

Image

If the model will influence the backend choosen in llama.cpp?

First Bad Commit

No response

Compile command

cmake -B build -DGGML_BLAS=ON -DGGML_BLAS_VENDOR=OpenBLAS
cmake --build build --config Release

Relevant log output

system_info: n_threads = 8 (n_threads_batch = 8) / CPU : SSE3 = 1 | OPENMAP = 1 | REPACK = 1|

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions