LLM API Test

An open-source tool that benchmarks LLM API endpoints, including OpenAI-compatible, Claude and self-hosted, by measuring first-token latency and output speed. Self-hostable with Docker.