r/databricks
Are you using Databricks Materialized Views for your Gold layers yet? Thoughts?
- upvotes
- 23
- comments
- 17
Post
Highlighted: the lines this signal was extracted from
Hey everyone, I’ve been implementing Databricks Materialized Views for executive reporting (Gold layer aggregates like daily revenue summaries, customer 360 metrics, etc.) and wanted to see how others are using them in production. Historically, keeping summary tables up to date meant writing custom MERGE INTO scripts, managing orchestration dependencies, or dealing with sluggish standard views that re-scanned massive Delta tables on every query. Having the platform automatically handle incremental updates under the hood via serverless compute has been a massive time-saver. Curious to hear your experiences: Are you fully embracing Materialized Views for Gold layer reporting, or sticking to traditional Delta tables with custom upsert logic? Have you run into any gotchas regarding compute costs or refresh frequencies with larger datasets? How do they hold up when dealing with complex multi-table joins and apportioned aggregations?
Also quoted as evidence
[comment u/ninilich] MVs are the wrong tool for Gold. They are strictly not recommended for GOLD for enterprise-grade data platforms.
[comment u/Proud-Passion-3668] We're migrating our existing notebooks and orchestration to MVs and SDP. Our pipelines run faster, cheaper, and we don't need to handle the order of execution.