package

python3.14-exllamav3

Description

Quantization and inference library for running LLMs locally on modern consumer-class GPUs.

Metadata

Version

0.0.25

License

Status

Source

pkgs/development/python-modules/exllamav3/default.nix:91

Homepage

https://github.com/turboderp-org/exllamav3

Maintainers (1)

BatteredBunny

Platforms (2)

Linux

Windows

Show all

x86_64-linux
x86_64-windows