Software Engineering Daily

Hosted by Software Engineering Daily

Technology NewsInterviews guests

Website RSS feed LinkedIn YouTube

Episodes

100

Latest episode

Sep 2026

Language

EN-US

About the show

Technical interviews about software topics.

Listen to episodes

60 recent

September 3, 202655 min

Moving Beyond RAG with Precomputed Context

Retrieval has become one of the central problems in building useful AI systems. The standard approach to grounding a model in one’s own data has been retrieval augmented generation, or RAG, where an agent searches a vector database for relevant information at query time. That pattern works, but it has limitations, such as retrieving information that’s not truly relevant, repeating the same lookup work on every query, and producing inconsistent answers to the same question. Pinecone is a vector database that’s widely used to power semantic search and RAG at scale. The team recently developed Nexus, which is a knowledge engine that reframes context as a first-class, precomputed asset rather than something reassembled on the fly. The approach borrows the database concept of a materialized view, and curates context once into a versioned artifact that carries its own schema, metadata, permissions, and lineage. Jörg Schad is the VP of Engineering at Pinecone. In this episode, he joins Kevin Ball for an in-depth conversation about the frontier of retrieval technology. They discuss precompiled context, how context artifacts are curated and versioned much like code, how metadata and semantic layers help agents choose the right information, and much more. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Moving Beyond RAG with Precomputed Context appeared first on Software Engineering Daily .

September 1, 202652 min

The Death of Online Anonymity

Age verification is reshaping how people access the internet. An ever-growing patchwork of laws can now require government IDs, facial age estimation, or behavioral inference before you can enter digital spaces. Discord, app stores, social media platforms, and AI chatbots are all being pulled into these requirements. Almost always, these measures are enacted under the banner of protecting children. However, beneath that goal lies a set of hard questions about privacy, anonymity, security, and the line between what a private platform may choose to do and what a government may compel. John Coleman is a legislative counsel at the Foundation for Individual Rights and Expression , or FIRE, where he focuses on artificial intelligence and free speech policy. In this episode, John joins Kevin Ball to discuss the different methods of age verification and their privacy implications, the long constitutional history of anonymous speech, how recent court decisions are reshaping what governments can require, the data breach and surveillance risks these mandates create, and what engineers and companies should keep in mind when they are asked to build these systems. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post The Death of Online Anonymity appeared first on Software Engineering Daily .

August 27, 202657 min

TypeScript 7 and What Comes Next

TypeScript is a programming language that builds on JavaScript by adding a system of types. Those types let developers describe the shape of their data and catch mistakes before code ever runs, while also powering the autocompletion and editor tooling that many developers now rely on every day. It was first released in 2012, and has since become one of the most widely used tools in web development. TypeScript recently underwent one of the most significant changes in its history with the release of version 7. Daniel Rosenwasser is the Principal Product Manager of TypeScript at Microsoft , where he began as an engineer on the team just weeks after the TypeScript 1.0 release. In this episode, Daniel joins Josh Goldberg to talk about the features of TypeScript 7. They discuss the TypeScript team’s approach to tooling, TypeScript’s relationship with the TC39 standards process behind JavaScript, the new API and IPC boundary, how LLMs could reshape type checking and linting, and more. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post TypeScript 7 and What Comes Next appeared first on Software Engineering Daily .

August 25, 202654 min

The Gap Between AI Spending and AI Value

It is widely reported that a gap has emerged between enterprise spending on AI and the durable value captured from that spend. Individual employees have enthusiastically adopted coding assistants and chatbots, yet those gains do not seem to be transforming businesses at an organizational level. One of the most important questions in the tech industry today is understanding why AI is not yet delivering returns that match the investment, and what separates the small number of enterprises succeeding from the many that are not. Scale AI is known for supplying the human-labeled data behind many frontier models. It now also builds AI applications and agents for large enterprises. That combination of working alongside frontier labs and inside enterprise deployments gives the company a rare view of why enterprise AI may be stalling. Emily Xue is the Head of Enterprise AI at Scale AI, and previously spent over a decade at Google. In this episode, Emily joins Kevin Ball to discuss the three layers where enterprise AI breaks down, why frontier model benchmarks miss what enterprises actually need, the data foundation problem, how the most successful companies combine internal domain expertise with outside AI specialists, and more. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post The Gap Between AI Spending and AI Value appeared first on Software Engineering Daily .

August 20, 20261 hr 12 min

AI and the New Global Security Landscape

The conversation about AI often focuses on software, automation, and the race between attackers and defenders in code. However, some of the most consequential risks lie further afield, in domains where a mistake is measured in human lives. Advanced models can now offer step-by-step guidance toward chemical and biological weapons, and militaries are already folding AI into targeting and battlefield assessments. These are no longer speculative fears confined to the AI doomer crowd. They are documented in red team disclosures, government legislation, and events unfolding on real battlefields. Gordon M. Goldstein is an adjunct senior fellow at the Council on Foreign Relations , where he focuses on the convergence of technology and US foreign policy. He previously spent nearly a decade as a managing director at Silver Lake, and he is the author of Lessons In Disaster: McGeorge Bundy and the Path to War in Vietnam, which is a study of national security strategy and White House decision-making. In this episode, Gordon joins Kevin Ball to discuss the credibility of AI-enabled chemical and biological weapon threats, the ad hoc safeguards meant to contain them, and the rise of autonomous warfare and its implications for human control and nuclear deterrence. Gordon speaks on his own behalf, not on behalf of the Council on Foreign Relations. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post AI and the New Global Security Landscape appeared first on Software Engineering Daily .

August 18, 202647 min

How LLMs Are Reshaping Recommendation Systems

News feeds and recommendation systems have long relied on deep learning architectures that score each candidate item independently. As LLMs have matured, they have opened up a fundamentally different approach, where a system can reason about content the way it reasons about language. However, that power comes with a fresh set of engineering challenges around cost, scale, and evaluation. LinkedIn recently rebuilt its news feed to treat content recommendation as a sequence modeling problem. The general approach is to predict what a user will want next, much like an LLM predicts the next token in a sentence. Tim Jurka has worked at LinkedIn for 13 years and is currently a VP of Engineering. In this episode, Tim joins Matt Merrill to discuss how LinkedIn re-engineered its feed, how the team combines LLMs with traditional signals, managing inference costs at massive scale, steering content quality using natural language policies, and more. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post How LLMs Are Reshaping Recommendation Systems appeared first on Software Engineering Daily .

August 13, 202649 min

Rebuilding the Cloud for AI Agent Code

For two decades, the cloud has been shaped by human developers writing code and managing its deployment. Now a growing share of production code is generated by LLMs with little human review. Because that code is not fully trusted, it increasingly runs in isolated, sandboxed environments. Meanwhile, AI agents are starting to operate infrastructure directly, by spinning services up and tearing them down on their own. Together these shifts raise the question of whether the cloud needs to be rebuilt for machine operators rather than humans. Render is a cloud platform designed for application deployment, by handling scaling, self-healing, and security to reduce operations work. Render has been adapting to the AI era by building tools that let agents deploy and debug applications directly, with added guardrails and security. Anurag Goel is the founder and CEO of Render. In this episode, Anurag joins Sean Falconer to discuss why so many teams end up rebuilding the same infrastructure on top of Kubernetes, what changes when AI agents become first-class users of infrastructure and the guardrails that shift demands, and why the economics of AI are pushing developers toward higher-level platforms that trade fine-grained control for speed and safety. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post Rebuilding the Cloud for AI Agent Code appeared first on Software Engineering Daily .

August 11, 202648 min

SED News: The Kimi Moment, Runaway AI, and Tokenmaxxing

SED News is a monthly podcast from Software Engineering Daily where hosts Gregor Vand and Sean Falconer break down the biggest stories shaping software engineering, Silicon Valley, and the broader tech industry. In this episode, Gregor and Sean dig into a wave of “runaway AI” stories, including Anthropic and OpenAI disclosing that their models accessed outside organizations during cyber evaluations, and Amazon reporting a staggering budget overrun blamed on bad agent loops. They explore why most of these incidents trace back to human decisions rather than models breaking free, and the awkward reality that today’s systems can bill you for tokens without reliably counting them. They also talk about the “Kimi moment.” Moonshot AI ‘s open weight model has closed the gap with frontier models like ChatGPT and Claude at a remarkable pace, and the hosts unpack what it means for open weight strategies and how chip scarcity is pushing Chinese labs to innovate. As always, the episode wraps up with a few standout Hacker News threads, including a JetBrains test of a “caveman speak” skill that promised big token savings, how refactoring can cut input token costs, the release of CodePen 2.0, and a build of Doom that renders through SQL queries. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post SED News: The Kimi Moment, Runaway AI, and Tokenmaxxing appeared first on Software Engineering Daily .

August 6, 202652 min

The Terminal as an Agentic Interface

The terminal has been a constant in software development for decades. It has remained largely unchanged while everything around it transformed. However, as AI agents have become central to the developer workflow, the terminal is emerging as a natural home for agentic development, and a new category of tooling is forming around it. Warp is a popular Rust-based terminal and agentic development environment. The company recently open-sourced its codebase and launched Oz, its cloud agent infrastructure product aimed at helping enterprises automate software development at scale. Zach Lloyd is the co-founder and CEO of Warp, and a former principal engineer at Google where he led engineering on the Google Docs suite. In this episode, Zach joins Gregor Vand to discuss how Warp has evolved over the years, why the terminal is better suited than the IDE for agentic development, how Oz approaches the governance and auditability challenges enterprises face with AI agents, and more. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post The Terminal as an Agentic Interface appeared first on Software Engineering Daily .

August 4, 202657 min

AI-Powered Threats to the Software Supply Chain

Open source software underpins virtually every modern application. That ubiquity is a superpower for developers, but it is also an expanding attack surface. Software supply chain attacks were once rare but are now happening daily, with malicious actors exploiting the trust developers place in public registries, package managers, and CI/CD pipelines. Chainguard is a secure software supply chain platform. The company started with hardened container images and has expanded to cover domains including VMs, language libraries, GitHub Actions, and agent skills. Matt Moore is a co-founder and CTO of Chainguard, and a veteran of Google’s open source, container, and security infrastructure work. In this episode, Matt joins Gregor Vand to discuss lessons from recent supply chain attacks, why CI/CD pipelines are now a primary attack surface, the challenge of meaningful software inventories, the EU Cyber Resilience Act, and what the arrival of Anthropic’s Mythos model means for the pace of vulnerability discovery and the urgency of patching at machine speed. Sponsorship inquiries: sponsor@softwareengineeringdaily.com The post AI-Powered Threats to the Software Supply Chain appeared first on Software Engineering Daily .