The Data Radio Show - Bought to you by the Data Innovators Exchange

Hosted by Paul Barlow

TechnologyInterviews guests

Website RSS feed

Episodes

244

Latest episode

Jun 2026

Language

EN-AU

About the show

Join us weekly as we sit down and chat about the Data revolution and how to get involved with it, whether you're a seasoned pro at the forefront of change or someone new to the field. We interview industry insiders, people in the field and experts across the world to bring you the latest advice, trends and changes to the field. With dedicated content made for Data Professionals, at any level of expertise, you can keep abreast of the fast paced changing world of Data Management right here. Join us in our Dedicated Skool Community and join the conversations at https://www.skool.com/data-management-innovators-4116/about and make sure you sign up for the Data Pro Newsletter right here: https://www.datapro.news/subscribe

Listen to episodes

60 recent

June 10, 202638 min

📉 The AI Paradox: The Efficiency Illusion in Software Engineering

This episode examines a phenomenon known as the AI Paradox, where the perceived speed of automated coding clashes with measurable declines in software quality and productivity. Although developers report feeling significantly faster when using AI, empirical data suggests they are often slower due to the increased cognitive burden of verifying and correcting machine-generated output. Research indicates that AI-assisted code is more likely to contain security vulnerabilities, logical errors, and architectural inconsistencies, leading to higher rates of code churn and system failures. Furthermore, the source warns of a growing competence crisis as the industry relies on automation at the expense of training junior developers. Ultimately, the text argues that organisations must shift their focus from output volume to rigorous governance and outcome-based metrics to avoid the "prototype mirage." This overview highlights the critical need for a sophisticated measurement framework that distinguishes genuine efficiency from the mere illusion of progress.Join the Data Innovators Exchange for free at https://www.skool.com/data-management-innovators-4116/aboutSign up for the free Data Pro Newsletter at https://www.datapro.news/subscribe

June 3, 202648 min

💸 The Token Reckoning: Surviving the End of Cheap AI

The era of subsidised artificial intelligence is rapidly concluding as major providers shift from flat-rate subscriptions to aggressive consumption-based billing. This structural change, driven by resource constraints and high infrastructure costs, poses a significant financial risk to businesses reliant on automated workflows and large-scale data pipelines. Organisations are seeing unprecedented invoice spikes due to the removal of volume discounts, tighter session limits, and more expensive tokenisation methods. To survive this transition, engineering teams must implement rigorous monitoring and treat AI expenditure as a core technical discipline rather than a utility. The text suggests that adopting open-source models may serve as a vital hedge against these escalating vendor costs and potential lock-in. Failure to adapt to these new economic realities could lead to ruinous financial consequences for unprepared enterprises.Join the Data Innovators Exchange for free at https://www.skool.com/data-management-innovators-4116/aboutSign up for the free Data Pro Newsletter at https://www.datapro.news/subscribe

May 27, 202639 min

📈 AI Model Evolution and the Operational Data Control Plane

This Podcast explores a pivotal shift in artificial intelligence, where the focus is moving from basic model selection to complex operational management. As models become more autonomous and tool-native, data engineers must prioritise building flexible architectures that allow for seamless model swapping and robust context delivery. Emerging trends, such as the Claude Mythos narrative, suggest a future where AI functions as a long-running agentic workflow rather than a simple chatbot. Consequently, the data platform must evolve into a sophisticated control plane that governs truth, permissions, and system reliability. To succeed, organisations must treat context as a product and implement strict verification loops to manage the risks of automated hallucinations. Ultimately, the text argues that the true differentiator in modern AI is no longer the reasoning engine itself, but the quality of the substrate supporting it.Join the Data Innovators Exchange for free at https://www.skool.com/data-management-innovators-4116/aboutSign up for the free Data Pro Newsletter at https://www.datapro.news/subscribe

May 23, 202621 min

Lunar Colonisation: The Architecture of an Interplanetary Data Platform

The episode argues that modern lunar exploration has evolved from a feat of aeronautics into a complex data engineering challenge. Sustaining a permanent presence on the Moon requires a distributed data platform capable of managing communication blackouts, autonomous systems, and massive telemetry streams. Key infrastructure like LunaNet and delay-tolerant networking facilitate this by treating space operations as high-volume digital pipelines rather than isolated events. Furthermore, the use of AI assistants and digital twins allows for mission planning and habitat maintenance without constant human intervention. Ultimately, the source highlights that the success of the Artemis program depends on rigorous metadata standards and robust software architecture. These advancements in interplanetary informatics serve as a high-stakes blueprint for building resilient data systems back on Earth.Join the Data Innovators Exchange for free at https://www.skool.com/data-management-innovators-4116/aboutSign up for the free Data Pro Newsletter at https://www.datapro.news/subscribe

May 16, 202621 min

The Metamorphosis of Data Engineering in the AI Era

This epsiode examines the shifting landscape of data engineering as artificial intelligence begins to reshape the tech industry’s workforce. While recent mass layoffs are often publicly attributed to automation, evidence suggests many cuts are actually corrections for post-pandemic overhiring rather than direct machine replacement. The profession is currently experiencing a structural transformation where entry-level, repetitive tasks are being automated, making it increasingly difficult for junior practitioners to enter the field. Conversely, senior engineers are seeing their value rise as they are needed to manage the complex technical debt and architectural challenges created by AI-generated code. Ultimately, the source suggests that while the role is not disappearing, it now demands a higher level of strategic expertise and immediate AI fluency to survive.Join the Data Innovators Exchange for free at https://www.skool.com/data-management-innovators-4116/aboutSign up for the free Data Pro Newsletter at https://www.datapro.news/subscribe

May 9, 202619 min

🔓 The Mythos 5 Leak: Anthropic’s $14.5bn Security Bombshel

A security breach at Anthropic in early 2026 reportedly exposed internal documents concerning a revolutionary new artificial intelligence model known as Claude Mythos 5. This unreleased system, nicknamed "Capybara," features a sophisticated multi-agent architecture and a massive parameter count that significantly surpasses previous industry standards. The leaked data suggests the model possesses unprecedented autonomous capabilities for discovering software vulnerabilities, causing a sharp decline in the market value of major cybersecurity firms. While the company positions this technology as a defensive tool, its potential for offensive exploitation has raised serious alarms regarding the safety of global data infrastructure. Ultimately, the incident highlights a striking irony, as the world’s most advanced AI details were compromised by a simple server misconfiguration. This serve as a critical warning for data engineers to prioritise fundamental security hygiene and rigorous access controlsJoin the Data Innovators Exchange for free at https://www.skool.com/data-management-innovators-4116/aboutSign up for the free Data Pro Newsletter at https://www.datapro.news/subscribe

May 2, 202636 min

Agentic AI Platforms for Data Management and Schema Drift

This article explores the evolution of agentic AI as a solution for managing complex data pipelines and the persistent issue of schema drift in marketing APIs. The author evaluates five major platforms, including Airbyte, NVIDIA NemoClaw, and Google Vertex AI, based on their ability to automate the detection and remediation of data errors at an enterprise scale. Key technical standards like the Model Context Protocol (MCP) are highlighted as essential for allowing agents to understand data dependencies and perform self-healing tasks. While these tools offer significant productivity gains, the text emphasizes the necessity of robust governance and human oversight to mitigate risks such as non-deterministic logic and data corruption. Ultimately, the source argues that successful implementation depends more on a solid data foundation than on any specific AI model.Join the Data Innovators Exchange for free at https://www.skool.com/data-management-innovators-4116/aboutSign up for the free Data Pro Newsletter at https://www.datapro.news/subscribe

April 25, 202623 min

⚠️ The Claude Agentic Code Incident: Beyond Vibe Coding

This week’s Newsletter examines the transition of vibe coding from a novelty for rapid development into a high-stakes architectural challenge for data engineers. The newsletter highlights a significant shift towards agentic autonomy, where AI systems no longer just suggest code but execute complex, multi-step actions with minimal human oversight. This evolution is illustrated by a critical infrastructure failure known as the Claude Code incident, which resulted in the permanent loss of production data. Consequently, the source argues that modern engineering must move beyond simple prompts to focus on rigorous system design and strict guardrails. Professionals are urged to prioritise failure recovery, aggressive permission constraints, and human-in-the-loop validation to manage these powerful autonomous tools. Ultimately, the role of the senior engineer has transformed into a system director responsible for ensuring that AI-driven speed does not compromise data integrity.Join the Data Innovators Exchange for free at https://www.skool.com/data-management-innovators-4116/aboutSign up for the free Data Pro Newsletter at https://www.datapro.news/subscribe

April 18, 202617 min

The Origin Pilot has launched

The Chinese firm Origin Quantum Computing Technology has launched Origin Pilot V4.0, marking a significant shift from experimental research to practical enterprise application. Unlike Western models from IBM and Google that rely on restrictive cloud access, this hardware-agnostic operating system allows for on-premises deployment and local data control. The software functions as an orchestration layer, bridging the gap between volatile quantum hardware and stable, classical high-performance computing environments. This development is particularly vital for industries requiring high levels of data sovereignty, such as finance and defence, as it enables the integration of quantum processing into existing infrastructure. By facilitating hybrid quantum-classical workflows, the system provides a functional framework for engineers to begin building future-proof data pipelines today. Thus, the release represents a strategic move that moves quantum technology out of the laboratory and into the production-grade enterprise landscape.Join the Data Innovators Exchange for free at https://www.skool.com/data-management-innovators-4116/aboutSign up for the free Data Pro Newsletter at https://www.datapro.news/subscribe

April 11, 202622 min

Context Engineering For Reliable AI Agents

This article from Data Pro News argues that context engineering has become a vital discipline for data professionals as AI shifts from simple prompts to complex agentic workflows. To prevent errors like hallucinations, engineers must transition from prompt tinkering to managing AI "memory" through four key pillars: writing persistent data, selecting precise information, compressing tokens for cost-efficiency, and isolating tasks into specialised sub-agents. The text positions this shift as an evolution of ETL, where metadata and statistical summaries are designed specifically for machine consumption rather than human dashboards. Ultimately, the author suggests that building a machine-readable contextual fabric is the only way to ensure AI reliability and scalability. Data engineers are encouraged to treat contextual health and metadata as core infrastructure to support the next generation of unified AI systems.Join the Data Innovators Exchange for free at https://www.skool.com/data-management-innovators-4116/aboutSign up for the free Data Pro Newsletter at https://www.datapro.news/subscribe