Forum Discussion
victoryamaykin
10 months agoAdvocate I
Last Refresh table in Databricks or in power query?
I have this extra table to get the last refresh time. Is it more efficient to have this saved in Power Query or build a dedicated table in our Azure Databricks gold layer? Thanks let date = D...
- 10 months ago
Hi victoryamaykin,
There are actually two useful timestamps: (1) when your data was last loaded into your warehouse/lake (“data freshness”), and (2) when your Power BI model was last refreshed (“report freshness”). Where you generate the timestamp determines which one you’re showing.- Report freshness (recommended in Power BI): Create a one-row table in Power Query using DateTimeZone.FixedUtcNow() so it’s stamped at refresh time and stays consistent across all queries during that refresh. Convert to local time in the report if needed. See the M/Power Query date-time functions here: Power Query date functions.
- Data freshness (recommended in Databricks): Write a tiny “meta” table in your gold layer that your orchestration updates at the end of the pipeline (e.g., SELECT current_timestamp() AS data_last_loaded). Then show both values in the report: “Data last loaded” (gold) and “Report last refreshed” (Power Query).
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
v-tejrama
10 months agoCommunity Support
Hi victoryamaykin ,
Thank you tayloramy for the response provided!
Has your issue been resolved? If the response provided by the community member addressed your query, could you please confirm? It helps us ensure that the solutions provided are effective and beneficial for everyone.
Thank you for your understanding!