*🔹 Try Cloudera Free Trial:* https://www.cloudera.com/products/cloudera-public-cloud-trial.html?internal_keyplay=ALL&internal_campaign=FY25-Q1-GLOBAL-CDP-5-Day-Trial&cid=FY25-Q1-GLOBAL-CDP-5-Day-Trial&internal_link=WWW-Nav-u01 In this video, Cloudera's Director of Developers, Dipankar breaks down what an open table format actually is in a Lakehouse architecture. Table formats are not new and Databases have had their own storage formats for decades. But in the lakehouse world, things have changed. In this video, Dipankar walks through: ✅ Where table formats originated (from the relational model to modern systems) ✅ Why proprietary storage formats led to engine lock-in ✅ How Hive introduced one of the first open table abstractions in data lakes ✅ What a table format actually is in a lakehouse ✅ The core components: schema, partitions, stats, commit history, file paths ✅ Why modern formats like Apache Iceberg, Delta Lake, and Apache Hudi bring openness and interoperability Join the Cloudera Community to learn more! 👉https://community.cloudera.com Explore the Full Series: 👉 https://www.youtube.com/playlist?list=PLe-h9HrA9qfDEdAxiPj9TqEAavd79Aneu *Get Started* 🔹 Watch Demos: https://www.cloudera.com/products/cloudera-data-platform/cdp-demos.html 🔹 Customer Success Stories: https://www.cloudera.com/customers.html 🔹 Read the Cloudera blog: https://www.cloudera.com/blog.html *Resources:* Full Playlist: https://www.youtube.com/playlist?list=PLe-h9HrA9qfC1_ayMoZB3eyQADG3-iC9X Hear more from our customers: https://www.youtube.com/playlist?list=PLe-h9HrA9qfABGzjKR86Sycoyq83EjLl9 Watch Demos: https://www.youtube.com/playlist?list=PLe-h9HrA9qfCZIH6ji5hxKucwXi0xvBSi Chapters: 00:00 Intro: What does openness mean in a Lakehouse? 00:41 Episode Focus: Drill Down into Open Table Formats 01:05 Are Table Formats a new concept? (A brief history) 01:37 Comparative Analysis: PostgreSQL vs. Oracle Storage 02:13 The Foundation: Edgar Codd’s Relational Model 03:08 Evolution: From Logical Models to Early Databases 04:05 The Challenge: Proprietary Formats & Engine Lock-in 05:10 Big Data World: Hadoop, MapReduce, and Java Skills 06:15 The Rise of Apache Hive Table Format 07:22 Architecture: Where do Table Formats sit in the stack? 08:33 Logical View vs. Physical Data Files 09:23 How it Works: Reader and Writer APIs 11:15 Internals: Schema, Partitioning, and Statistics 12:13 Commit History, Snapshots, and Rollbacks 13:13 Iceberg, Hudi, or Delta Lake: Which one to choose? 14:00 The Meaning of "Openness" in Table Formats 15:10 Open vs. Closed: How to break engine lock-in? 16:13 Conclusion & Next Episode: Iceberg Deep Dive *Connect with Cloudera* Subscribe to stay ahead of the curve with the latest in data strategy, open architectures, and enterprise AI innovations. https://www.cloudera.com LinkedIn ► https://www.linkedin.com/company/cloudera Facebook ► https://www.facebook.com/cloudera/ X ► https://x.com/cloudera Spotify ► https://open.spotify.com/show/102S8zoZR6nmZV0HxZlxZu #Cloudera #datalakehouse #apacheiceberg #dataengineering #lakehouse #deltalake #ApacheHudi #OpenTableFormats #bigdata #cloudera #moderndatastack #dataarchitecture #cloudcomputing #enterpriseai #opensource #datastrategy #Iceberg #DataLake #DataArchitecture #DataManagement #CloudData #TechTutorial #HowTo

 308      12