Kimi K3 in C is a portable C99 inference engine built to run the 2.78-trillion-parameter Kimi K3 model on CPUs without BLAS, machine-learning frameworks, or GPUs. It demonstrates inference from a roughly 1.56 TB checkpoint with measured memory use as low as 8.24 GB. The runtime streams model trunk layers and routed experts from disk instead of keeping all weights resident in memory. Memory presets balance pinned layers and an expert LRU cache for laptops, desktops, workstations, and servers. Incremental generation preserves KV cache and recurrent state between tokens. The repository also includes tokenization, safetensors loading, diagnostics, benchmarks, trace replay, and comparisons against a PyTorch reference.

Features

  • Portable C99 CPU inference engine
  • Disk-streamed model layers and experts
  • Low-memory execution starting near 8 GB
  • Configurable memory and caching presets
  • Incremental KV and recurrent-state generation
  • Benchmarks and PyTorch reference validation

Project Samples

Project Activity

See All Activity >

Categories

AI Models

License

Apache License V2.0

Follow Kimi K3 in C

Kimi K3 in C Web Site

Other Useful Business Software
Endpoint Management with Remote Control Built In Icon
Endpoint Management with Remote Control Built In

Patch, monitor, and connect to Windows and macOS devices from one console

Save 50% on your first year when you switch from your existing RMM to Splashtop AEM. Automate patching, track inventory, and jump directly into 1-click unattended remote sessions without switching tools.
Start Free Trial
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Kimi K3 in C!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

C

Related Categories

C AI Models

Registered

2026-08-06