Forum Discussion
Query folding
- 1 year ago
How to verify your query is folded (Databricks + Value.NativeQuery):
-
Value.NativeQuery already sends SQL to Databricks. Folding only matters for steps after that step.
-
In Power Query, right-click the last step >> View Native Query.
-
Clickable = still folded to SQL.
-
Greyed out = folding broke earlier.
-
-
Do a quick litmus test: add Keep Top Rows >> 5 (or filter a date). Recheck View Native Query.
-
If you see LIMIT 5 (or your WHERE clause) in the SQL, it’s folded.
-
-
Cross-check in Databricks >> SQL >> Query History while preview/refresh runs.
-
Your server log should show the final SQL with your filters. If it shows SELECT * and filters aren’t there, they were applied locally.
-
-
Remember: many steps break folding (e.g., Table.Buffer, custom M, merges with non-foldable sources). Put them after you’ve narrowed data.
-
Hi,
I'm facing the same issue, not sure if query folding works or not. I can see in query history the query runs in a few seconds but the incremental refresh is taking a lot (almost two hours).
Is this a known issue related to the Databricks connector?
can you explain what do you mean by incremental refresh taking alot of time ?