AICI
Microsoft Research's Wasm-based interface between LLM inference engines and controller programs that constrain output by regex, grammar or custom logic and steer generation.
Open sourceCoding & Development
Visit website(opens in a new tab)
Microsoft Research's Wasm-based interface between LLM inference engines and controller programs that constrain output by regex, grammar or custom logic and steer generation.