Delegation, Agent Router, and AI Traffic
transcript
show notes
Erica Hughberg is a software engineering leader, speaker, and community advocate at Tetrate. She maintains Agent Router, formerly Envoy AI Gateway, working on documentation, the website, and community.
Dan and Erica compare coding agents with engineering management, from delegating work and taking responsibility to planning and reviewing the result. They discuss missing system context, authentication mistakes, and how subject matter experts can use agents to build and learn, including a researcher's move from SPSS to R.
Erica explains why she uses a scheduled Claude task for project triage and when a separately deployed agent might make sense. She also introduces Agent Router and its Envoy foundation, tracing the demands of inference and MCP traffic through provider failover, large payloads, long-running requests, and the hardware that moves and processes them.
Chapters
- (00:00) - Engineering management as preparation for agents
- (06:38) - What agents miss about teams and systems
- (14:16) - Planning more and testing uncertainty
- (20:11) - Authentication mistakes and checking data work
- (23:16) - Helping a researcher move from SPSS to R
- (28:35) - A seven-year-old builds a game
- (31:14) - Learning engineering with agents
- (40:53) - Who needs to build and deploy an agent?
- (51:09) - Choosing among open source projects
- (53:51) - Agent Router and the engineers of arrows
- (58:16) - Inference costs, failover, and proxy foundations
- (01:04:23) - Large payloads and encryption hardware
- (01:10:51) - Long requests, event loops, and proxy history
- (01:18:54) - MCP multiplexing and session management
- (01:23:46) - Payload limits and planning proxy capacity
⠀
Links from the show
--------------------
- Agent Router
- Envoy Proxy
- OAuth
- SPSS
- R
- Lovable
- Cloud Run
- Kubernetes
- NGINX
- C10K problem
- NVIDIA BlueField DPUs
- eBPF
- MCP
⠀
Guests
-------
Erica Hughberg, Maintainer of Agent Router and Manager at Tetrate
⠀
Follow the podcast
-------------------
⠀
Follow Dan Gerlanc
-------------------