Litellm

LiteLLM: LLM Gateway for managing and accessing 100+ LLMs in OpenAI format.