Tagged
For a retailer DW exit (~42 TB logical, 18 nightly Glue jobs), Aurora→Redshift zero-ETL retired 11 jobs and cut dashboard freshness from 6h → ~15 min — concurrency scaling on zero-ETL (March 2026) absorbed Monday open spikes.
Copying curated Parquet into every consumer account is how data platforms drown in storage cost and permission sprawl. On Feb 11, 2026 AWS shipped Lake Formation cross-account version 5 — wildcard RAM shares for hundreds of thousands of tables. A composite 12-account platform cut duplicate curated copies from 3 to 0 and dropped cross-account access tickets from ~11/month to ~3 by standardizing LF-Tags + resource links.
Glue 5.1 (Spark 3.5.6, Iceberg 1.10.0) for lakehouse ETL. July 2026 refresh — Iceberg v2 vs v3, Lake Formation writes, compaction, Athena compatibility.
Glue does EL; dbt does T. July 2026 refresh — Glue 5.1 DPU economics, dbt-athena/Redshift, and the combined stack most teams converge on.
S3 + Glue + Athena is the canonical AWS data-lake stack. It's also the one teams over-engineer the fastest. A reference architecture with the partitioning scheme, the Glue crawler config, and the Athena cost guardrails that keep query bills predictable as the lake grows.