Serving AI models locally using familiar container workflows.
Ramalama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
0.12.2aarch64-darwinaarch64-freebsdaarch64-linuxaarch64-windowsarmv5tel-linuxarmv6l-linuxarmv7a-linuxarmv7l-linuxi686-cygwini686-freebsdi686-linuxi686-windowsloongarch64-linuxm68k-linuxmicroblaze-linuxmicroblazeel-linuxmips-linuxmips64-linuxmips64el-linuxmipsel-linuxpowerpc-linuxpowerpc64-linuxpowerpc64le-linuxriscv32-linuxriscv64-linuxs390-linuxs390x-linuxx86_64-cygwinx86_64-darwinx86_64-freebsdx86_64-linuxx86_64-windows