Skip to content

Misc. bug: linux/arm64 does not exist for the server docker image #13891

Open
@reindervdw-cmi

Description

@reindervdw-cmi

Name and Version

llama-server latest image

Operating systems

Mac

Which llama.cpp modules do you know to be affected?

llama-server

Command line

docker run --platform=linux/arm64 ghcr.io/ggml-org/llama.cpp:server

Problem description & steps to reproduce

In the documentation here (https://github.com/ggml-org/llama.cpp/blob/master/docs/docker.md) it is stated that the following image is available: ghcr.io/ggml-org/llama.cpp:server: This image only includes the server executable file. (platforms: linux/amd64, linux/arm64). However, the linux/arm64 image does not seem to exist.

First Bad Commit

No response

Relevant log output

Unable to find image 'ghcr.io/ggml-org/llama.cpp:server' locally
server: Pulling from ggml-org/llama.cpp
215ed5a63843: Pull complete
35f537cd716b: Pull complete
3da632892524: Pull complete
c2666443224a: Pull complete
4f4fb700ef54: Pull complete
Digest: sha256:707db50b2e0d0fca27100e35685a01ddcf533dd4a622951be3319e4b7908836b
Status: Downloaded newer image for ghcr.io/ggml-org/llama.cpp:server
docker: image with reference ghcr.io/ggml-org/llama.cpp:server was found but its platform (linux/amd64) does not match the specified platform (linux/arm64).
See 'docker run --help'.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions