Description
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
Use any LLM as a drop in replacement for gpt-3.5-turbo. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
1.52.16
bin/litellm
aarch64-darwin
aarch64-freebsd
aarch64-linux
aarch64-windows
armv5tel-linux
armv6l-linux
armv7a-darwin
armv7a-linux
armv7l-linux
i686-cygwin
i686-darwin
i686-freebsd
i686-linux
i686-windows
loongarch64-linux
m68k-linux
microblaze-linux
microblazeel-linux
mips-linux
mips64-linux
mips64el-linux
mipsel-linux
powerpc64-linux
powerpc64le-linux
riscv32-linux
riscv64-linux
s390-linux
s390x-linux
x86_64-cygwin
x86_64-darwin
x86_64-freebsd
x86_64-linux
x86_64-windows