Skip to content

DMR: plugin install #22664

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Jun 3, 2025
Merged

DMR: plugin install #22664

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
87b3f06
dmr: plugin install
ArthurFlag May 16, 2025
f46fa58
update acronyms
ArthurFlag May 19, 2025
a185c78
trim
ArthurFlag May 20, 2025
6acd0c0
update reqs
ArthurFlag May 21, 2025
aecead7
Update content/manuals/ai/model-runner.md
ArthurFlag May 22, 2025
aa5ccee
feedback
ArthurFlag May 23, 2025
39b090a
remove Engine version req
ArthurFlag May 23, 2025
3d132ee
trigger GH
ArthurFlag May 30, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions _vale/Docker/Acronyms.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,7 @@ exceptions:
- DCT
- DEBUG
- DHCP
- DMR
- DNS
- DOM
- DPI
Expand Down Expand Up @@ -85,8 +86,8 @@ exceptions:
- LTS
- MAC
- MATE
- MCP
- mcp
- MCP
- MDM
- MDN
- MSI
Expand All @@ -105,8 +106,8 @@ exceptions:
- PATH
- PDF
- PEM
- PID
- PHP
- PID
- POSIX
- POST
- QA
Expand Down
33 changes: 32 additions & 1 deletion content/manuals/ai/model-runner.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
group: AI
weight: 20
description: Learn how to use Docker Model Runner to manage and run AI models.
keywords: Docker, ai, model runner, docker deskotp, llm
keywords: Docker, ai, model runner, docker desktop, docker engine, llm

Check failure on line 11 in content/manuals/ai/model-runner.md

View workflow job for this annotation

GitHub Actions / vale 

[vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'llm'?

Raw Output:
{"message": "[Vale.Spelling] Did you really mean 'llm'?", "location": {"path": "content/manuals/ai/model-runner.md", "range": {"start": {"line": 11, "column": 68}}}, "severity": "ERROR"}

Check failure on line 11 in content/manuals/ai/model-runner.md

View workflow job for this annotation

GitHub Actions / vale 

[vale] reported by reviewdog 🐶
[Vale.Terms] Use 'Docker Engine' instead of 'docker engine'.

Raw Output:
{"message": "[Vale.Terms] Use 'Docker Engine' instead of 'docker engine'.", "location": {"path": "content/manuals/ai/model-runner.md", "range": {"start": {"line": 11, "column": 53}}}, "severity": "ERROR"}

Check failure on line 11 in content/manuals/ai/model-runner.md

View workflow job for this annotation

GitHub Actions / vale 

[vale] reported by reviewdog 🐶
[Vale.Terms] Use 'Docker Desktop' instead of 'docker desktop'.

Raw Output:
{"message": "[Vale.Terms] Use 'Docker Desktop' instead of 'docker desktop'.", "location": {"path": "content/manuals/ai/model-runner.md", "range": {"start": {"line": 11, "column": 37}}}, "severity": "ERROR"}
aliases:
- /desktop/features/model-runner/
- /ai/model-runner/
Expand Down Expand Up @@ -45,6 +45,37 @@

You can now use the `docker model` command in the CLI and view and interact with your local models in the **Models** tab in the Docker Desktop Dashboard.

### Enable DMR in Docker Engine

1. Ensure you have installed [Docker Engine](/engine/install/).
2. DMR is available as a package. To install it, run:

{{< tabs >}}
{{< tab name="Ubuntu/Debian">}}

```console
$ sudo apt-get update
$ sudo apt-get install docker-model-plugin
```

{{< /tab >}}
{{< tab name="RPM-base distributions">}}

```console
$ sudo dnf update
$ sudo dnf install docker-model-plugin
```

{{< /tab >}}
{{< /tabs >}}

3. Test the installation:

```console
$ docker model version
$ docker model run ai/smollm2
```

## Integrate the Docker Model Runner into your software development lifecycle

You can now start building your Generative AI application powered by the Docker Model Runner.
Expand Down
2 changes: 1 addition & 1 deletion data/summary.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -152,7 +152,7 @@ Docker GitHub Copilot:
availability: Early Access
Docker Model Runner:
availability: Beta
requires: Docker Desktop 4.40 and later
requires: Docker Engine or Docker Desktop (Windows) 4.41+ or Docker Desktop (MacOS) 4.40+
for: Docker Desktop for Mac with Apple Silicon or Windows with NVIDIA GPUs
Docker Projects:
availability: Beta
Expand Down
3 changes: 3 additions & 0 deletions hugo_stats.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,7 @@
"RHEL-8",
"RHEL-9",
"RHEL-CentOS-or-Fedora",
"RPM-base-distributions",
"Raw",
"React",
"Regular-install",
Expand All @@ -106,6 +107,7 @@
"Specific-version",
"Svelte",
"Ubuntu",
"Ubuntu/Debian",
"Unix-pipe",
"Updated-Dockerfile",
"Use-Docker-Init",
Expand All @@ -114,6 +116,7 @@
"Using-the-GUI",
"Using-the-MCP-Toolkit-Recommended",
"VS-Code",
"Via-Docker-Desktop-Recommended",
"Vue",
"WSL-2-backend-Arm-Early-Access",
"WSL-2-backend-x86_64",
Expand Down