MyNixOS website logo
MyNixOS website logo
Flakes
Categories
Options
Packages
option-set

services.tabbyapi.settings.memory

Showing entries 1-3 out of 3.
services.tabbyapi.settings.memory.cuda_malloc_asyncNixOS option
Use the cudaMallocAsync backend in Torch
services.tabbyapi.settings.memory.sysmem_kv_cacheNixOS option
Size of system memory second-tier key/value cache, in MB
services.tabbyapi.settings.memory.sysmem_recurrent_cacheNixOS option
Max size of recurrent cache in system memory, in MB