ggml-org/llama.cpp

LLM inference in C/C++

# llama.cpp  LLM inference in C/C++ [](https://opensource.org/licenses/MIT) [](https://github.com/ggml-org/llama.cpp/releases?q=tag:v0) [](https://github.com/ggml-org/llama.cpp/releases?q=b) [](https://github.com/ggml-org/llama.cpp/actions/workflows/server.yml) [](https://github.com/ggml-org/llama.cpp/actions/workflows/docker.yml) [](https://github.com/ggml-org/llama.cpp/actions/workflows/winget.yml) [ggml](https://github.com/ggml-org/ggml) / [ops](https://github.com/ggml-org/llama.cpp/blob/master/docs/ops.md) / [maintainer PRs](https://github.com/ggml-org/llama.cpp/pulls?q=is%3Apr%20is%3Aopen%20draft%3AFalse%20(author%3Asanmai%20OR%20author%3Argerganov%20OR%20author%3AKitaitiMakoto%20OR%20author%3Adanbev%20OR%20author%3Aaldehir%20OR%20author%3Amax-krasnyansky%20OR%20author%3ACISC%20OR%20author%3Aggerganov%20OR%20author%3Aam17an%20OR%20author%3Ajhen0409%20OR%20author%3Abartowski1182%20OR%20author%3Anikwen%20OR%20author%3Ahipudding%20OR%20author%3Aravi9%20OR%20author%3AServeurpersoCom%20OR%20author%3Athelittlefireman%20OR%20author%3Apwilkin%20OR%20aut