Index index by Group index by Distribution index by Vendor index by creation date index by Name Mirrors Help

The search service can find package by either name (apache), provides(webserver), absolute file names (/usr/bin/apache), binaries (gprof) or shared libraries (libXm.so.2) in standard path. It does not support multiple arguments yet...

The System and Arch are optional added filters, for example System could be "redhat", "redhat-7.2", "mandrake" or "gnome", Arch could be "i386" or "src", etc. depending on your system.

System Arch

RPM resource llama-cpp-server

OpenAI API compatible server for llama-cpp. The server also serves an embedded web UI at http://HOST:PORT/ . Config: /etc/sysconfig/llama-server systemctl start returns as soon as llama-server is running. HTTP is up immediately; /health and /v1/chat/completions return HTTP 503 {"error":{"message":"Loading model"}} until the GGUF is in RAM/VRAM (a 6–8B model on GPU is typically ~1 minute, a 20–30G Q8 several minutes). Wait on /health before sending completions: until curl -sf http://localhost:8080/health; do sleep 1; done curl http://localhost:8080/v1/chat/completions \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $(grep ^API_KEY= /etc/sysconfig/llama-server 2>/dev/null |cut -d= -f2-)" \ -d '{"model":"any","messages":[{"role":"user","content":"Hello"}]}' Authorization must match API_KEY in /etc/sysconfig/llama-server (omit the header if API_KEY is unset). Apertus 1.0 (Instruct-2509) and Apertus 1.5 (swiss-ai/Apertus-v1.5-*) are both supported. 1.5 needs a matching mmproj GGUF for image/audio.

Found 1 sites for llama-cpp-server

Found 2 RPM for llama-cpp-server

PackageSummaryDistributionDownload
llama-cpp-server-0.4.0-2.aarch64.htmlOpenAI API compatible server for llama-cppOpenMandriva Cooker for aarch64llama-cpp-server-0.4.0-2.aarch64.rpm
llama-cpp-server-0.4.0-2.x86_64.htmlOpenAI API compatible server for llama-cppOpenMandriva Cooker for x86_64llama-cpp-server-0.4.0-2.x86_64.rpm

Generated by rpm2html 1.6

Fabrice Bellet