Forum Discussion
Separating a date/ time column to date column and time column without breaking query folding
Hi DanaG ,
As far as I know, currently change the date type to time will not produce query folding in power bi.
Generally, the following list describes transformations that can be query folded.
-
Removing columns.
-
Renaming columns (SELECT column aliases).
-
Filtering rows, with static values or Power Query parameters (WHERE clause predicates).
-
Grouping and summarizing (GROUP BY clause).
-
Expanding record columns (source foreign key columns) to achieve a join of two source tables (JOIN clause).
-
Non-fuzzy merging of fold-able queries based on the same source (JOIN clause).
-
Appending fold-able queries based on the same source (UNION ALL operator).
-
Adding custom columns with simple logic (SELECT column expressions). Simple logic implies uncomplicated operations, possibly including the use of M functions that have equivalent functions in the SQL data source, like mathematic or text manipulation functions.
- Pivoting and unpivoting (PIVOT and UNPIVOT operators).
If the last applied step broke the query folding, when you configure incremental refresh, you would see this warnning message:
Not recommend but not forbidden that this incremental refresh could work but can cause incremental refresh to be very slow, and the process can run out of resources either in the Power BI service or in the on-premises data gateway if used.
Please refer: Query folding in incremental refresh
Best Regards,
Community Support Team _ Yingjie Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.-
Once you get incremental refresh, how important does folding become? In any case, you should be able to create your Date and Time columns as Calculated Columns (and use the DateTime column for incremental refresh). In that case you still have the DateTime column adding unwanted size to your model.
Regards,
Pat
Thank you for your response Pat - I am a bit confused now.
I was trying to maintain query folding until the last applied step for the table I want to have incremental refresh on.
I can duplicate the date column without breaking the query folding - the step of changing the data type to Time that breaks the folding.
If I understand you correctly - does it mean that I can still implement incremental refresh even if the last applied step broke the query folding?
I can apply data type changes in the Data model section (once the data was imported after the query editor) however the relationships don't seem to work - meaning data is not displayed in the visuals.
Hi DanaG ,
As far as I know, currently change the date type to time will not produce query folding in power bi.
Generally, the following list describes transformations that can be query folded.
-
Removing columns.
-
Renaming columns (SELECT column aliases).
-
Filtering rows, with static values or Power Query parameters (WHERE clause predicates).
-
Grouping and summarizing (GROUP BY clause).
-
Expanding record columns (source foreign key columns) to achieve a join of two source tables (JOIN clause).
-
Non-fuzzy merging of fold-able queries based on the same source (JOIN clause).
-
Appending fold-able queries based on the same source (UNION ALL operator).
-
Adding custom columns with simple logic (SELECT column expressions). Simple logic implies uncomplicated operations, possibly including the use of M functions that have equivalent functions in the SQL data source, like mathematic or text manipulation functions.
- Pivoting and unpivoting (PIVOT and UNPIVOT operators).
If the last applied step broke the query folding, when you configure incremental refresh, you would see this warnning message:
Not recommend but not forbidden that this incremental refresh could work but can cause incremental refresh to be very slow, and the process can run out of resources either in the Power BI service or in the on-premises data gateway if used.
Please refer: Query folding in incremental refresh
Best Regards,
Community Support Team _ Yingjie Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.-