Open Source AI

llama.cpp

Efficient local LLM inference

C/C++ inference that made local LLMs practical on CPUs and consumer hardware.

localinferenceC++

Overview

C/C++ inference that made local LLMs practical on CPUs and consumer hardware.

llama.cpp is listed in Axioniq’s curated Open Source AI collection. Open-source models, frameworks, and communities that keep the AI ecosystem inspectable and portable.

At a glance

Listed under Open Source AI.
Efficient local LLM inference
Tagged for local.
Tagged for inference.
Tagged for C++.

Who it’s for

operators researching AI and enterprise technology vendors

Category context

Open-source models, frameworks, and communities that keep the AI ecosystem inspectable and portable.

Compare peers in Open Source AI or jump straight to the official llama.cpp site.