A non-Turing-complete DSL that compiles high-level LLM routing and agent policies directly into verified infrastructure artifacts like Kubernetes NetworkPolicies.
March 31, 2026
Original Paper
From Inference Routing to Agent Orchestration: Declarative Policy Compilation with Cross-Layer Verification
arXiv · 2603.27299
The Takeaway
It enables practitioners to manage agent orchestration, privacy (PII detection), and deployment security from a single declarative source, eliminating the policy drift that occurs when moving from prompt engineering to production infrastructure.
From the abstract
The Semantic Router DSL is a non-Turing-complete policy language deployed in production for per-request LLM inference routing: content signals (embedding similarity, PII detection, jailbreak scoring) feed into weighted projections and priority-ordered decision trees that select a model, enforce privacy policies, and produce structured audit traces -- all from a single declarative source file. Prior work established conflict-free compilation for probabilistic predicates and positioned the DSL wit