services.llama-cpp

Whether to enable LLaMA C++ server

Extra flags passed to llama-cpp-server

IP address the LLaMA C++ server listens on

Model path

Open ports in the firewall for LLaMA C++ server

The llama-cpp package to use

Listen port for LLaMA C++ server