Binary package “llama.cpp-tools” in openkylin huanghe
LLM inference in C/C++ - main utilities (RVV build)
llama.cpp enables LLM inference with minimal setup on a wide range of
hardware.
.
This package contains the most commonly used utilities: llama-cli,
llama-server, llama-bench and llama-quantize.