package

python3.13-exllamav3

Description

Quantization and inference library for running LLMs locally on modern consumer-class GPUs.

Metadata

Version

1.4.3

License

Status

Source

pkgs/development/python-modules/exllamav3/default.nix:89

Homepage

https://github.com/turboderp-org/exllamav3

Maintainers (1)

BatteredBunny

Platforms (2)

Linux

Windows

Show all

x86_64-linux
x86_64-windows