What interface to use for hardware acceleration.
null: default behavior- if
nixpkgs.config.rocmSupportis enabled, uses"rocm" - if
nixpkgs.config.cudaSupportis enabled, uses"cuda" - otherwise defaults to
false
- if
false: disable GPU, only use CPU"rocm": supported by most modern AMD GPUs- may require overriding gpu type with
services.ollama.rocmOverrideGfxif rocm doesn't detect your AMD gpu
- may require overriding gpu type with
"cuda": supported by most modern NVIDIA GPUs.