Skip to content
Sign in
Artwork for Slightly Caffeinated
Slightly Caffeinated · Saturday · 27 min

Fall Vibes, AI Evals, and Code Review Bots

TJ Miller and Chris Gmyr compare the AI code review bots they are each building at work, from fixture repos of real PRs to requiring a line of code behind every finding. TJ also shares the eval-driven wizard he built to turn source material into learning content, sharing insights on building AI systems you can test and trust. Links Ask a question or suggest a topic Podcast: Site | Twitter/X | Bluesky Chris: Site | Twitter/X | Bluesky TJ: Site | Twitter/X | Bluesky References Mentioned Hive - Chris's orchestration framework Gorillaz - the show TJ saw in Detroit Deltron 3030 - the opener and TJ's all-time favorite hip hop artist Luma Brighter Learning - where TJ is building the learning content wizard and the PR review bot Claude Opus 5.5 - the model TJ wants to move the content wizard to, then rerun the evals Prism - TJ's Laravel AI package, which needs updates before the model upgrade GitHub Copilot - the reviewer that caught real issues TJ's bot missed, and the inline comment style Chris wants to copy CodeRabbit - one of the review services both teams passed on in favor of building their own Amazon Bedrock - where Chris's reviewer runs to keep code inside their own infrastructure

0:00 · Welcome, Hive, and Scouts season-27:58
Play in
Transcript file

transcript

No transcript — this publisher did not publish one.

show notes

TJ Miller and Chris Gmyr compare the AI code review bots they are each building at work, from fixture repos of real PRs to requiring a line of code behind every finding. TJ also shares the eval-driven wizard he built to turn source material into learning content, sharing insights on building AI systems you can test and trust.

Links

References Mentioned

  • Hive - Chris's orchestration framework
  • Gorillaz - the show TJ saw in Detroit
  • Deltron 3030 - the opener and TJ's all-time favorite hip hop artist
  • Luma Brighter Learning - where TJ is building the learning content wizard and the PR review bot
  • Claude Opus 5.5 - the model TJ wants to move the content wizard to, then rerun the evals
  • Prism - TJ's Laravel AI package, which needs updates before the model upgrade
  • GitHub Copilot - the reviewer that caught real issues TJ's bot missed, and the inline comment style Chris wants to copy
  • CodeRabbit - one of the review services both teams passed on in favor of building their own
  • Amazon Bedrock - where Chris's reviewer runs to keep code inside their own infrastructure
links19

chapters

14 chapters

more episodes

All episodes