What interface to use for hardware acceleration.
null
: default behavior- if
nixpkgs.config.rocmSupport
is enabled, uses"rocm"
- if
nixpkgs.config.cudaSupport
is enabled, uses"cuda"
- otherwise defaults to
false
- if
false
: disable GPU, only use CPU"rocm"
: supported by most modern AMD GPUs- may require overriding gpu type with
services.ollama.rocmOverrideGfx
if rocm doesn't detect your AMD gpu
- may require overriding gpu type with
"cuda"
: supported by most modern NVIDIA GPUs.