llama.cpp

📖 项目简介

C++ 实现的高性能 LLM 推理引擎，支持在消费级硬件上运行大模型。

🔗 GitHub 项目地址

https://github.com/ggerganov/llama.cpp

🔄 可替代的商用软件

OpenAI API

📝 项目原文介绍（英文）

llama.cpp Manifesto / ggml / ops LLM inference in C/C++ Recent API changes - Changelog for libllama API - Changelog for llama-server REST API Hot topics - Hugging Face cache migration: models downloaded with -hf are now stored in the standard Hugging Face cache directory, enabling sharing with other HF tools. - guide : using the new WebUI of llama.cpp - guide : running gpt-oss with llama.cpp - [[FEEDBACK] Better packaging for llama.cpp to support downstream consumers 🤗]( - Support for the gpt-os

💬 社区讨论