package

python3.14-exllamav2

Description

Inference library for running LLMs locally on modern consumer-class GPUs.

Metadata

Version

0.3.2

License

Status

Source

pkgs/development/python-modules/exllamav2/default.nix:94

Homepage

https://github.com/turboderp-org/exllamav2

Maintainers (1)

BatteredBunny

Platforms (2)

Linux

Windows

Show all

x86_64-linux
x86_64-windows