llama.cpp Python Bindings Files

Python bindings for llama.cpp

This is an exact mirror of the llama.cpp Python Bindings project, hosted at https://github.com/abetlen/llama-cpp-python. SourceForge is not affiliated with llama.cpp Python Bindings. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
llama_cpp_python-0.3.16-cp39-cp39-macosx_11_0_arm64.whl	2025-08-15	3.9 MB	0
llama_cpp_python-0.3.16-cp310-cp310-macosx_11_0_arm64.whl	2025-08-15	3.9 MB	0
llama_cpp_python-0.3.16-cp311-cp311-macosx_11_0_arm64.whl	2025-08-15	3.9 MB	0
llama_cpp_python-0.3.16-cp312-cp312-macosx_11_0_arm64.whl	2025-08-15	3.9 MB	0
v0.3.16-metal source code.tar.gz	2025-08-15	279.6 kB	0
v0.3.16-metal source code.zip	2025-08-15	322.0 kB	0
Totals: 6 Items		16.2 MB	0

Other Useful Business Software

Gen AI apps are built with MongoDB Atlas

Build gen AI apps with an all-in-one modern database: MongoDB Atlas

MongoDB Atlas provides built-in vector search and a flexible document model so developers can build, scale, and run gen AI apps without stitching together multiple databases. From LLM integration to semantic search, Atlas simplifies your AI architecture—and it’s free to get started.

Start Free

Photo and Video Editing APIs and SDKs

Trusted by 150 million+ creators and businesses globally

Unlock Picsart's full editing suite by embedding our Editor SDK directly into your platform. Offer your users the power of a full design suite without leaving your site.

Learn More

Recommended Projects

llama.cpp
The llama.cpp project enables the inference of Meta's LLaMA model (and other models) in pure C/C++ without requiring a Python runtime. It is designed for efficient and fast model execution, offering easy integration for applications needing LLM-based capabilities. The repository focuses on...
Ling
Ling is a Mixture-of-Experts (MoE) large language model (LLM) provided and open-sourced by inclusionAI. The project offers different sizes (Ling-lite, Ling-plus) and emphasizes flexibility and efficiency: being able to scale, adapt expert activation, and perform across a range of natural...
Qwen
Qwen is a series of large language models developed by Alibaba Cloud, consisting of various pretrained versions like Qwen-1.8B, Qwen-7B, Qwen-14B, and Qwen-72B. These models, which range from smaller to larger configurations, are designed for a wide range of natural language processing tasks....
DeepSeek R1
DeepSeek-R1 is an open-source large language model developed by DeepSeek, designed to excel in complex reasoning tasks across domains such as mathematics, coding, and language. DeepSeek R1 offers unrestricted access for both commercial and academic use. The model employs a Mixture of Experts...
Alpaca.cpp
Run a fast ChatGPT-like model locally on your device. This combines the LLaMA foundation model with an open reproduction of Stanford Alpaca a fine-tuning of the base model to obey instructions (akin to the RLHF used to train ChatGPT) and a set of modifications to llama.cpp to add a chat...

llama.cpp Python Bindings Files

Python bindings for llama.cpp

Get an email when there's a new version of llama.cpp Python Bindings