nCompass

An AI inference platform with an API for running open-source models in production, built to handle many concurrent requests without rate limits.