Tag: Apache Iceberg
All the articles with the tag "Apache Iceberg".
- 4 MIN READ•Mar 7, 2026
What is Apache Arrow? Erasing the Serialization Tax
If you pull a million records from a database into a Python notebook, the query runs instantly, but the transfer feels endlessly slow. Your compute en...
data lakehouseapache icebergapache parquet - 5 MIN READ•Mar 7, 2026
What is Apache Iceberg? The Table Format Revolution
If you drop ten thousand Parquet files into an S3 bucket, you have a data swamp. You do not have a database. To run SQL queries against those files sa...
data lakehouseapache icebergapache parquet - 4 MIN READ•Mar 7, 2026
What is Apache Parquet? Columns, Encoding, and Performance
If you ask a data analyst to calculate the average transaction amount for the month of July using a massive CSV file, the compute engine must read eve...
data lakehouseapache icebergapache parquet - 21 MIN READ•Mar 7, 2026
What is Apache Polaris? Unifying the Iceberg Ecosystem
Treating thousands of Parquet files as a unified database table requires a brain. Apache Iceberg provides the metadata structure to do this, but the Iceberg specification alone does not manage security roles, handle network requests, or broker credentials. You need an open catalog service to orchestrate those root metadata pointers. Apache Polaris serves as that open-source, vendor-neutral brain. This comprehensive guide explains the catalog fragmentation war, open governance under the Apache Software Foundation, role-based access control hierarchies, credential vending vs IAM sprawl, and how Polaris powers Dremio's agentic query acceleration.
data lakehouseapache icebergapache parquet - 6 MIN READ•Mar 7, 2026
Apache Software Foundation: History, Purpose, and Process
If you build a modern data lakehouse, you inevitably stack Apache Iceberg, Apache Parquet, and Apache Arrow. These projects dictate how you store, que...
data lakehouseapache icebergapache parquet - 4 MIN READ•Mar 7, 2026
Assembling the Apache Lakehouse: The Modular Architecture
For decades, the standard data architecture was monolithic. When you bought a data warehouse, you bought a single box where the vendor tightly coupled...
data lakehouseapache icebergapache parquet - 5 MIN READ•Feb 18, 2026
Partition and Organize Data for Performance
A table with 500 million rows takes 45 seconds to query. After partitioning it by date, the same query : filtering on a single day , returns in 2 seconds. Th...
data engineeringbest practicespartitioning - 4 MIN READ•Feb 18, 2026
Schema Evolution Without Breaking Consumers
A source team renames a column from `user_id` to `customer_id`. Twelve hours later, five dashboards show blank values, two ML pipelines fail, and the data en...
data engineeringbest practicesschema evolution - 5 MIN READ•Feb 18, 2026
Data Modeling for the Lakehouse: What Changes
Traditional data modeling assumed you controlled the database. You defined schemas up front, enforced foreign keys at write time, and optimized with indexes....
data modelingdata engineeringdata lakehouse - 8 MIN READ•Feb 13, 2026
A 2026 Introduction to Apache Iceberg
An updated introduction to Apache Iceberg
data lakehousedata engineeringapache iceberg - 7 MIN READ•Jan 15, 2026
Building Pangolin - My Holiday Break, an AI IDE, and a Lakehouse Catalog for the Curious
A personal story of how I built Pangolin Catalog over a holiday break using an AI-powered IDE.
data lakehousedata engineeringapache iceberg - 7 MIN READ•Dec 29, 2025
2025 Year in Review Apache Iceberg, Polaris, Parquet, and Arrow
A look back at key developments in Apache Iceberg, Polaris, Parquet, and Arrow in 2025.
data lakehousedata engineeringapache iceberg