ggml-org/llama.cpp
llama.cpp: C/C++ LLM Inference Engine
LLM inference in C/C++
AI-generated summary
llama.cpp is a high-performance inference engine for Large Language Models (LLMs) and Vision-Language Models (VLMs) written in plain C/C++. It aims for minimal setup and runs efficiently across a wide range of hardware, including Apple Silicon, x86 architectures with AVX support, and various GPUs.
Language: C++