Open
Description
I finetuned with Unsloth the Qwen/Qwen2.5-VL-7B-Instruct model. After finetuning i saved it with this command :
model.save_pretrained_merged("Finetuned_Model", tokenizer,) (it creates a folder that contains safetensors and json files) Then I tried to convert it to gguf so i can use it locally without gpu using the command: !python llama.cpp/convert_hf_to_gguf.py Finetuned_Model, but i have the below error:
ERROR:hf-to-gguf:Model Qwen2_5_VLModel is not supported
Metadata
Metadata
Assignees
Labels
No labels