Research Publications
vLLM Semantic Router: Signal Driven Decision Routing for Mixture-of-Modality Models
vLLM Semantic Router Team · arXiv Technical Report
The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project
Huamin Chen, Xunzhuo Liu, Bowei He, Fuyuan Lyu, Yankai Chen, Xue Liu, Yuhan Liu, Junchen Jiang · arXiv Technical Report
Visual Confused Deputy: Exploiting and Defending Perception Failures in Computer-Using Agents
Xunzhuo Liu, Bowei He, Xue Liu, Andy Luo, Haichen Zhang, Huamin Chen · arXiv Technical Report
Outcome-Aware Tool Selection for Semantic Routers: Latency-Constrained Learning Without LLM Inference
Huamin Chen, Xunzhuo Liu, Junchen Jiang, Bowei He, Xue Liu · arXiv Technical Report
Adaptive Vision-Language Model Routing for Computer Use Agents
Xunzhuo Liu, Bowei He, Xue Liu, Andy Luo, Haichen Zhang, Huamin Chen · arXiv Technical Report
98× Faster LLM Routing Without a Dedicated GPU: Flash Attention, Prompt Compression, and Near-Streaming for the vLLM Semantic Router
Xunzhuo Liu, Bowei He, Xue Liu, Andy Luo, Haichen Zhang, Huamin Chen · arXiv Technical Report
inference-fleet-sim: A Queueing-Theory-Grounded Fleet Capacity Planner for LLM Inference
Huamin Chen, Xunzhuo Liu, Yuhan Liu, Junchen Jiang, Bowei He, Xue Liu · arXiv Technical Report
FleetOpt: Analytical Fleet Provisioning for LLM Inference with Compress-and-Route as Implementation Mechanism
Huamin Chen, Xunzhuo Liu, Yuhan Liu, Junchen Jiang, Bowei He, Xue Liu · arXiv Technical Report
The 1/W Law: An Analytical Study of Context-Length Routing Topology and GPU Generation Gains for LLM Inference Energy Efficiency
Huamin Chen, Xunzhuo Liu, Yuhan Liu, Junchen Jiang, Bowei He, Xue Liu · arXiv Technical Report
Conflict-Free Policy Languages for Probabilistic ML Predicates: A Framework and Case Study with the Semantic Router DSL
Xunzhuo Liu, Hao Wu, Huamin Chen, Bowei He, Xue Liu · arXiv Technical Report
From Inference Routing to Agent Orchestration: Declarative Policy Compilation with Cross-Layer Verification
Huamin Chen, Xunzhuo Liu, Bowei He, Xue Liu · arXiv Technical Report
Knowledge Access Beats Model Size: Memory Augmented Routing for Persistent AI Agents
Xunzhuo Liu, Bowei He, Xue Liu, Andy Luo, Haichen Zhang, Huamin Chen · arXiv Technical Report
Fast and Faithful: Real-Time Verification for Long-Document Retrieval-Augmented Generation Systems
Xunzhuo Liu, Bowei He, Xue Liu, Haichen Zhang, Huamin Chen · SIGIR 2026 Industry Track
Token-Budget-Aware Pool Routing for Cost-Efficient LLM Inference
Huamin Chen, Xunzhuo Liu, Junchen Jiang, Bowei He, Xue Liu · arXiv Technical Report
When to Reason: Semantic Router for vLLM
Chen Wang, Xunzhuo Liu, Yuhan Liu, Yue Zhu, Xiangxi Mo, Junchen Jiang, Huamin Chen · NeurIPS - MLForSys
Category-Aware Semantic Caching for Heterogeneous LLM Workloads
Chen Wang, Xunzhuo Liu, Yue Zhu, Alaa Youssef, Priya Nagpurkar, Huamin Chen
Semantic Inference Routing Protocol (SIRP)
Huamin Chen, Luay Jalil · Internet Engineering Task Force (IETF)
Multi-Provider Extensions for Agentic AI Inference APIs
H. Chen, L. Jalil, N. Cocker · Internet Engineering Task Force (IETF) - Network Management Research Group
Conference Presentations
Intelligent LLM Routing: A New Paradigm for Multi-Model AI Orchestration in Kubernetes
Chen Wang, Huamin Chen · KubeCon NA 2025
vLLM Semantic Router: Unlock the Power of Intelligent Routing
Xunzhuo Liu · vLLM Meetup Beijing
AI-Powered vLLM Semantic Router
Huamin Chen · vLLM Office Hours