Laya is an open-source, non-autoregressive decision engine designed to answer structured questions without generating free-form text. It supports choice, score, and yes-or-no probability decisions in a single forward pass. The system works across more than 100 languages and uses a router to select an appropriate checkpoint for each request. It can run locally on CPU or GPU hardware and includes Python and TypeScript tooling. Integrations are available for HTTP, MCP, LangChain, LangGraph, LlamaIndex, CrewAI, and ONNX workflows. Laya is intended for fast classification, routing, triage, scoring, and other structured decisions where predictable outputs are more useful than generated prose.
Features
- Choice, score, and yes-or-no decisions
- Support for more than 100 languages
- Single-pass non-autoregressive inference
- Automatic checkpoint routing
- Python and TypeScript APIs
- HTTP, MCP, LangChain, and LlamaIndex integrations
Categories
AI ModelsLicense
Apache License V2.0Follow Laya
Other Useful Business Software
Ship Agents Faster
Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Laya!