Skip to content

Feature Request: when llama.cpp can support convert qwen2.5 VL 7B/72B model to gguf? #11541

Closed
@sooit

Description

@sooit

Prerequisites

  • I am running the latest code. Mention the version if possible as well.
  • I carefully followed the README.md.
  • I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

When llama.cpp can support convert qwen2.5 VL 7B/72B model files to gguf file?
I use command as below:
python convert_hf_to_gguf.py /home/jason/.cache/modelscope/hub/Qwen/Qwen2.5-VL-72B-Instruct --outfile qwen2_5_vl_72b_instruct.gguf --outtype f16

Got error messages as below:
INFO:hf-to-gguf:Loading model: Qwen2.5-VL-72B-Instruct
ERROR:hf-to-gguf:Model Qwen2_5_VLForConditionalGeneration is not supported

Motivation

I hope llama.cpp can quickly support different llm model as soon as possible.

Possible Implementation

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions