services.llama-cpp.extraFlags

Extra flags passed to llama-cpp-server.

Declarations

Type

list of string

Default

[ ]

Example

[
  "-c"
  "4096"
  "-ngl"
  "32"
  "--numa"
  "numactl"
]