Forum Discussion
Last Refresh table in Databricks or in power query?
Hi victoryamaykin,
There are actually two useful timestamps: (1) when your data was last loaded into your warehouse/lake (“data freshness”), and (2) when your Power BI model was last refreshed (“report freshness”). Where you generate the timestamp determines which one you’re showing.- Report freshness (recommended in Power BI): Create a one-row table in Power Query using DateTimeZone.FixedUtcNow() so it’s stamped at refresh time and stays consistent across all queries during that refresh. Convert to local time in the report if needed. See the M/Power Query date-time functions here: Power Query date functions.
- Data freshness (recommended in Databricks): Write a tiny “meta” table in your gold layer that your orchestration updates at the end of the pipeline (e.g., SELECT current_timestamp() AS data_last_loaded). Then show both values in the report: “Data last loaded” (gold) and “Report last refreshed” (Power Query).
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
Hi victoryamaykin,
There are actually two useful timestamps: (1) when your data was last loaded into your warehouse/lake (“data freshness”), and (2) when your Power BI model was last refreshed (“report freshness”). Where you generate the timestamp determines which one you’re showing.
- Report freshness (recommended in Power BI): Create a one-row table in Power Query using DateTimeZone.FixedUtcNow() so it’s stamped at refresh time and stays consistent across all queries during that refresh. Convert to local time in the report if needed. See the M/Power Query date-time functions here: Power Query date functions.
- Data freshness (recommended in Databricks): Write a tiny “meta” table in your gold layer that your orchestration updates at the end of the pipeline (e.g., SELECT current_timestamp() AS data_last_loaded). Then show both values in the report: “Data last loaded” (gold) and “Report last refreshed” (Power Query).
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
This is perfect. Thank you
