What is it?
Router (gating network)
The router, sometimes called the gating network, is the small, fast component inside a Mixture of Experts model that decides which experts should handle each token. Continuing the hospital analogy from Chapter 5, the router is the receptionist who glances at a patient and sends them to the right specialists.
The router is learned during training, not hand-coded. The model figures out on its own how to divide work among the experts.
From the Foundational Modelling glossary
Where Router is explained
- Mixtral and Mixture of Experts, More Brain, Same SpeedFoundational Modelling · The expert panel analogy
- The Taxonomy of Agentic RAG SystemsAgentic RAG · How to read the taxonomy as a whole
- The Building Blocks of Agentic IntelligenceAgentic RAG · The five workflow patterns
- Building the PromptBuilding Coding Agents and Harnesses · Real code: the call_id is copied, not invented