How Google Cloud Is Rebuilding Its Network for the AI Era
AI gets all the headlines, but the network underneath it rarely gets the credit. In this episode of Let’s Talk Shop, I sit down with Kevin Hutchins, VP of Cloud Networking at Google Cloud, to talk about what it really takes to build infrastructure for AI at planet scale. We cover how Google Cloud’s network is evolving for massive training and inference workloads, why bandwidth and latency matter as much as the accelerators themselves, and how Google stress-tests its network with the traffic of Search, YouTube, Maps, Workspace and Gemini. Kevin explains why enterprises need to rethink network design for agentic AI, moving from predictable one-to-many apps to unpredictable many-to-many agent traffic. At the heart of the conversation is agent governance: knowing every agent on your network, giving each one a verified identity and policies, routing every interaction through an agent gateway built on Envoy, and getting full observability and semantic-level security. We also get into whether AI will split the cloud into “enterprise” and “AI” clouds, how model routing at the gateway can tame inference costs, and how operations teams will manage fleets of agents running at machine speed. If you’re an IT leader, architect or platform engineer trying to figure out where to focus in the AI era, Kevin’s message is clear: governance first. Chapters 00:00 Intro 01:42 Is the network AI’s most misunderstood component? 04:00 How Google Cloud’s network is evolving for AI 06:52 Has AI fundamentally changed network design? 09:51 Stress-testing a network at Google scale 13:25 Designing networks for AI vs. traditional enterprise apps 18:15 Security, identity and governance for AI agents 24:20 What sets Google Cloud apart 29:58 Will AI fracture the cloud? 34:12 Tokenomics and the cost of inference 38:41 Model routing at the agent gateway 39:34 Managing agent fleets at machine speed 42:00 Wrap-up Sign Up Now for my online course "The Cloud Strategy Master Class": ► On my web site: https://lnkd.in/gcxcrX and use promo code LINKEDIN20 to receive a 20% discount. ► On Udemy: https://www.udemy.com/course/cloud-strategy-master-class/ PODCASTS: Listen wherever you get your podcasts: ► Let's Talk Shop: http://letstalkshop.buzzsprout.com ► Reality Distortion Fields RDFs Podcast: https://youtu.be/88z1UiVaV00 Follow me: ► TikTok: @ekhnaser ► Instagram: @ekhnaser ► Twitter: @ekhnaser ► LinkedIn: https://www.linkedin.com/in/eliaskhnaser/ ► Website: www.eliaskhnaser.com






