📖 项目简介
C++ 实现的高性能 LLM 推理引擎，支持在消费级硬件上运行大模型。
🔗 GitHub 项目地址
https://github.com/ggerganov/llama.cpp
🔄 可替代的商用软件
OpenAI API
📝 项目原文介绍（英文）
llama.cpp LLM inference in C/C++ ggml / ops / maintainer PRs%20sort%3Aupdated-desc) / dev stats / lib llama API / llama-server REST API Quick start A few options to get llama.cpp installed on your machine: bash curl curl -LsSf sh powershell irm iex - Visit and follow the instructions - Run with Docker - see our Docker documentation - Download pre-built binaries from the releases page - Build from source by cloning this repository - check out our build guide Once installed: sh Download and run a
💬 社区讨论
📌 server : reuse image features within a SystemOne request — 由 mshr-h 发布于 2026-10-18
📌 DSpark drafters on an 11 GB RTX 2080 Ti: Gemma 4 26B-A4B +76 % code / +24 % prose, and where DSpark loses — 由 homeofe 发布于 2026-10-18
📌 C++ Wrapper with Decisions — 由 MartinPerry 发布于 2026-10-18
📌 llama.cpp CLI included in AgentManager's tool catalog — 由 kevinelliott 发布于 2026-10-18
📌 Add a way to clear the whole prompt cache (slots + host RAM) — 由 yuya0408 发布于 2026-10-18