Gnarly Data Waves by Dremio

Hosted by Dremio (The Open Data Lakehouse Platform)

TechnologyInterviews guests

Website RSS feed

Episodes

Latest episode

Oct 2024

Language

EN-US

About the show

Gnarly Data Waves is a weekly show about the world of Data Analytics and Data Architecture. Learn about the technologies giving the company access to cutting-edge insights. If you work datasets, data warehouses, data lakes or data lakehouses, this show it for you! Join us for our live recordings to participate in the Q&A: dremio.com/events Subscribe to the Dremio youtube channel on: youtube.com/dremio Take the Dremio Platform for a free test-drive: https://www.dremio.com/test-drive/

Listen to episodes

60 recent

October 29, 202438 min

EP59: Charting the Course: The Evolution and Future of Apache Iceberg and Polaris

This session will provide a comprehensive overview of Iceberg's journey, its current role within the data ecosystem, and the promising future it holds with the integration of Polaris (incubating). We will discuss how these technologies redefine table formats and catalog management, empowering organizations to efficiently manage and analyze large-scale data. Attendees will gain valuable insights into the evolving landscape, ensuring they remain at the forefront of innovation and continue to shape thought leadership in the data ecosystem.

October 29, 202414 min

EP58 - Transforming the Landscape of Real-Time Data Analytics

Try Out Dremio on your Laptop: https://drmevn.fyi/youtubelakehouse102924

October 8, 20241 hr 4 min

EP57 - From Hadoop & Hive to Minio & Dremio: Moving Towards a Next Gen Data Architecture

Legacy data platforms often fall short of the performance, processing and scaling requirements for robust AI/ML initiatives. This is especially true in complex multi-cloud (public, private, edge, airgapped) environments. The combined power of MinIO and Dremio creates a data lakehouse platform that overcomes these challenges, delivering scalability, performance and efficiency to ensure successful AI initiatives. Watch Brenna Buuck, Sr. Technical Evangelist at MinIO and Alex Merced, Sr. Technical Evangelist at Dremio provided insights on: - AI Workflows: How a data lakehouse simplifies critical AI tasks like model training, refinement, feature selection and real-time inference for faster decisions - Scalability and Performance: How a data lakehouse architecture scales seamlessly to meet the fast-growing demands of AI applications - Data Management Efficiency: How a data lakehouse streamlines data management for IT teams, allowing them to focus on innovation

September 10, 202431 min

EP56 - What’s New in Dremio: Improved Automation, Performance + Catalog for Iceberg Lakehouses

Dremio unveiled new features in our latest release that enhance the creation, performance, and management of Apache Iceberg data lakehouses. You will learn how Dremio delivers market-leading SQL query and write performance, improved federated query security and management as well as streamlined data ingestion by delivering: - Live Reflections on Iceberg tables that will accelerate performance, ensure up-to-date data and reduce management overhead. - Result Set Caching that can accelerate query performance up to 28X - Merge-on-Read that can enhance write and ingestion speed - Auto Ingest Pipes that eliminate complex pipeline setup and maintenance - User Impersonation for federated queries that allows for granular permissions, better access control, and user workload tracking

August 21, 202414 min

EP55 - Unite Data Across Dremio, Snowflake, Iceberg, and Beyond

Organizations want to empower teams with data at their fingertips and in every part of their business. They want their teams to move quickly with data never as a bottleneck, but an accelerant to decision making —all without the curiosity tax too common in consumption-based cloud platforms. Dremio enables data teams to unify all of their disparate data, from Snowflake to Iceberg and other sources, by combining an intelligent semantic layer with a powerful SQL platform that eliminates silos, optimizes costs through intelligent query acceleration, and enables self-service analytics. You will how Dremio enables Snowflake users to: - Unify all of your data from Snowflake and all sources - Optimize analytics costs and performance - Use easy self-service analytics for faster time-to-insight - Ensure Apache Iceberg native compatibility for future-proof data access

August 20, 202450 min

EP54 - Mastering Semantic Layers: The Key to Data-Driven Innovation

Learn how to master semantic layers with Dremio. We will provide a high-level overview of their purpose in modern analytics, showing how they act as a bridge between complex data sources and business users. You’ll learn how semantic layers simplify data access, ensure consistency, and empower users to derive meaningful insights from data, regardless of their technical expertise. - The definition and core purpose of a semantic layer in data analytics: How it acts as a bridge between complex data and business users, simplifying data access and interpretation. - Key benefits and use cases of semantic layers: How they enable self-service analytics, ensure data consistency, and accelerate time-to-insight. - How Dremio's semantic layer technology can transform your data strategy: Dremio makes it easier to manage and leverage your data for faster, data-driven decision-making.

August 19, 202447 min

EP53 - Build the next-generation Iceberg lakehouse with Dremio and NetApp

Watch Vishnu Vardhan, Director of Product Management StorageGRID at NetApp and Alex Merced,Senior Technical Evangelist at Dremio, as they explore the future of data lakes and discover how NetApp and Dremio can revolutionize your analytics by delivering the next generation of lakehouse with Apache Iceberg. Transitioning to a modern data lakehouse environment allows organizations to increase business insight, reduce management complexity, and lower overall TCO of their analytics environments. The growing adoption of Apache Iceberg is a key enabler for building the next generation lakehouse. Its robust feature set, coupled with an open ecosystem for analytics use cases, including ACID transactions, time travel, and schema evolution, continues to drive rapid adoption. Vishnu and Alex will delve into market trends surrounding Iceberg, as well as key drivers for lakehouse adoption and modernization. You will learn about: - Iceberg adoption trends - NetApp StorageGRID and its benefits - The Dremio and NetApp data lakehouse solution - Key Iceberg data lakehouse modernization use cases - Customer examples

July 15, 20244 min

Apache Iceberg Lakehouse crash course

Watch and learn about Apache Iceberg. A 10 part web series designed to help you master Apache Iceberg. https://hello.dremio.com/webcast-an-apache-iceberg-lakehouse-crash-course-reg.html?utm_medium=social-free&utm_source=youtube&utm_content=webcast-gdw-se-the-architecture-of-apache-iceberg-apache-hudi-and-delta-lake-intro&utm_campaign=webcast-gdw-se-the-architecture-of-apache-iceberg-apache-hudi-and-delta-lake-intro The "An Apache Iceberg Lakehouse Crash Course" an in-depth webinar series designed to provide a comprehensive understanding of Apache Iceberg and its pivotal role in modern data lakehouse architectures. Over the course of ten sessions, you'll explore a wide range of topics: - foundational concepts like data lakehouses - table formats to advanced features such as partitioning, optimization, and streaming with Apache Iceberg - Each session will offer detailed insights into the architecture and capabilities of Apache Iceberg, alongside practical demonstrations of data ingestion using tools like Apache Spark and Dremio.

July 3, 202457 min

EP51 - Scania’s Journey in Navigating and Implementing Data Mesh

As the demand for data analytics grows, and with a decentralized approach at its core, Major Swedish manufacturer Scania needed to balance domain autonomy and alignment, while implementing a self-serve data & governance platform, coupled with a unified way of accessing data. Discover how Scania addressed these challenges by adopting a data mesh strategy, and how using Dremio and Witboost has facilitated their journey. Learn about the cultural shifts, changes, and partnerships that are driving tangible business impacts. Additionally, gain insights and trends from Dremio’s Field CDO and the co-founder and CTO Witboost. Ready to Get-Started: https://www.dremio.com/get-started/?utm_medium=website&utm_source=youtube&utm_content=gdw-od&utm_campaign=gdw-ep51 See all upcoming episodes and past episodes: https://www.dremio.com/gnarly-data-waves/?utm_medium=website&utm_source=youtube&utm_content=gdw-od&utm_campaign=gdw-ep51 Connect with us! Community Forum: https://bit.ly/2ELXT0W Github: https://bit.ly/3go4dcM Blog: https://bit.ly/2DgyR9B Questions?: https://bit.ly/30oi8tX Website: https://bit.ly/2XmtEnN Resource: https://www.dremio.com/resources/?utm_medium=website&utm_source=youtube&utm_content=gdw-od&utm_campaign=gdw-ep51 Events: https://www.dremio.com/events/?utm_medium=website&utm_source=youtube&utm_content=gdw-od&utm_campaign=gdw-ep51

June 25, 202441 min

EP52 - The Best of the Subsurface Data Lakehouse Conference 2024

Join us for a captivating recap of Subsurface 2024—the leading conference at the intersection of data engineering, open source technology, and modern data architecture. This webinar will distill: - highlights of the conference, - curated clips of inspiring keynotes, - insightful discussions on real-world data lakehouse implementations by industry leaders such as Nomura, NetApp, and Blue Cross. - and deep dives into the transformative potential of open source projects like Apache Iceberg, Apache XTable, and Ibis. Whether you missed the conference or want to revisit its most impactful moments, this webinar offers a unique opportunity to stay ahead of the curve in the rapidly evolving data landscape. Don't miss this chance to gain valuable insights from the experts and innovators who are shaping the future of data. - Article on Dremio Auto-Ingest: https://www.dremio.com/blog/introducing-auto-ingest-pipes-event-driven-ingestion-made-easy/ - Article on Dremio and Hybrid Data Lakehouses (Vast, Netapp, Minio): https://www.dremio.com/blog/3-reasons-to-create-hybrid-apache-iceberg-data-lakehouses/ --------------------------------------------------------------- Get Hands-on with the Data Lakehouse ---------------------------------------------------------------- - Apache Iceberg Lakehouse on your Laptop: https://bit.ly/am-dremio-lakehouse-laptop - SQLServer to Iceberg to Dashboard: https://bit.ly/am-sqlserver-dashboard - MongoDB to Iceberg to Dashboard: https://bit.ly/am-mongodb-dashboard - Postgres to Iceberg to Dashboard: https://bit.ly/am-postgres-to-dashboard - MySQL to Iceberg to Dashboard: https://bit.ly/am-dremio-mysql-dashboard - Elasticsearch to Iceberg to Dashboard: https://bit.ly/am-dremio-elastic - Apache Druid to Iceberg to Dashboard: https://bit.ly/am-druid-dremio - JSON/CSV/Parquet to Iceberg to Dashboard: https://bit.ly/am-json-csv-parquet-dremio - From Kafka to Iceberg to Dremio: https://bit.ly/am-kafka-connect-dremio - Lowering Snowflake Costs with Dremio: https://bit.ly/am-dremio-snowflake-spend