LiteLLM

An AI gateway and Python SDK for calling over 100 LLM APIs in OpenAI format, with cost tracking, guardrails, load balancing and logging.

Visit website(opens in a new tab)