Project Every Record Counts: Data Engineering for Backend Engineers
Part 9: "Who Owns the Truth" — Catalogs and the Iceberg REST Protocol
Finance wants to query gold sales, and Rohan offers them a read key for the bucket. Ingrid shows what else that key reads. The catalog as control plane: from Hive Metastore to the Iceberg REST protocol, Polaris principals, roles and grants, credential vending through STS, four engines on one table, and an analyst refused on raw by the catalog and by the storage itself.