Description
An experimental port of OpenAI's Tokenizer to lua.
The Lua module written in Rust that provides Tiktoken support for Lua.
package
lua5.3-tiktoken_core
Metadata
Version
0.2.5-1License
MIT
Maintainers (1)
Platforms (44)
Darwin
FreeBSD
Linux
NetBSD
OpenBSD
Redox
Solaris
Windows
Show all
aarch64-darwinaarch64-freebsdaarch64-linuxaarch64-netbsdarmv5tel-linuxarmv6l-linuxarmv6l-netbsdarmv7a-linuxarmv7a-netbsdarmv7l-linuxarmv7l-netbsdi686-cygwini686-freebsdi686-linuxi686-netbsdi686-openbsdloongarch64-linuxm68k-linuxm68k-netbsdmicroblaze-linuxmicroblazeel-linuxmips-linuxmips64-linuxmips64el-linuxmipsel-linuxmipsel-netbsdpowerpc-linuxpowerpc-netbsdpowerpc64-linuxpowerpc64le-linuxriscv32-linuxriscv32-netbsdriscv64-linuxriscv64-netbsds390-linuxs390x-linuxx86_64-cygwinx86_64-darwinx86_64-freebsdx86_64-linuxx86_64-netbsdx86_64-openbsdx86_64-redoxx86_64-solaris