MyNixOS website logo

What interface to use for hardware acceleration.

  • null: default behavior
    • if nixpkgs.config.rocmSupport is enabled, uses "rocm"
    • if nixpkgs.config.cudaSupport is enabled, uses "cuda"
    • otherwise defaults to false
  • false: disable GPU, only use CPU
  • "rocm": supported by most modern AMD GPUs
    • may require overriding gpu type with services.ollama.rocmOverrideGfx if rocm doesn't detect your AMD gpu
  • "cuda": supported by most modern NVIDIA GPUs.
Declarations
Type
null or one of false, "rocm", "cuda"
Default
null
Example
"rocm"