NandhaKishorM / laya
git clone https://github.com/NandhaKishorM/laya.git
v0.4.12 · 8d ago
Python library for non-autoregressive typed decisions (choice, score, yes/no) over text in 100+ languages, with a per-request checkpoint router.
Why you might care
Gets structured decisions from a single forward pass (about 33 ms per the README) instead of prompting an LLM, so it suits high-volume triage or routing where latency and cost matter. A router selects the appropriate checkpoint per request, including a multilingual model for long inputs up to 8,192 tokens, and fine-tuning is supported for domain accuracy.
+89
stars, 24h · #485
+729
stars, 7 days · #343
+~3.1k
stars, 30 days · #302
34k
★ total · +2% this week
3.1k
forks · 114 open issues
Star history (as recorded here)
LanguagePython
LicenseApache-2.0
Created2026-09-18 (1mo ago)
Last push1d ago
Watchers122
OwnerUser
GitHub topics
calibrationclassificationdecision-modelhuggingfacejevmodernbertmultilingualnlppythonpytorchroutingtyped-decisionszero-shot
Links
- GitHub: github.com/NandhaKishorM/laya
- Homepage: https://huggingface.co/convaiinnovations/laya
- Releases · Issues · Hacker News mentions
README
Loading README…
Blurb generated by claude-haiku-5-5 1d ago. Star deltas marked ~ are extrapolated from partial history.