Incremental Refresh Problem

[uzuntasgokberk]

Hello everyone, as we know there are ıncremental refresh in Dataflow and Power BI.

In the below page shows of example Dataflow gen1 ıncremental refresh. My question is here when ı open 'Detect data changes' for my date/time column. İt doesn't automatically refresh(Even I added sample data which increase CREATED_DATE in my sql). İs it normal? I faced same problem in Power BI desktop( İf it is unchecked 'Get the latest data in real time with DirectQuery (Premium only)')

Kind Regards,
Gökberk Uzuntaş

🔗 Stay Connected:
📘 Medium |
📺 YouTube |
💼 LinkedIn |
📷 Instagram |
🐦 X |
👽 Reddit |
🌐 Website |
🎵 TikTok |

[lbendlin · Accepted solution]

If you have a Pro license you can open a Pro ticket at https://admin.powerplatform.microsoft.com/newsupportticket/powerbi
Otherwise you can raise an issue at https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues .

[lbendlin]

Do not use the same column for the partition boundaries and the change detection. Find a different column (like Last Modified Date) or do not use change detection at all.

[uzuntasgokberk]

Hello @lbendlini,

I tried this way too. However, ıt doesn't work even I use different column such as ETL_Date etc. Even ETL_Date is increasing the dataflow doesn't refresh automatically. 

Kind Regards,
Gökberk Uzuntaş

📌 If this post helps, then please consider Accepting it as a solution and giving Kudos — it helps other members find answers faster!

🔗 Stay Connected:
📘 Medium |
📺 YouTube |
💼 LinkedIn |
📷 Instagram |
🐦 X |
👽 Reddit |
🌐 Website |
🎵 TikTok |

[lbendlin]

Go back to basics - don't use "Detect Data Changes", run two refreshes, and examine the run history results (download the CSV and check how many partitions have been touched in each run)

[uzuntasgokberk]

Hello @lbendlin,

I don't have any problem without using 'Detect Data Changes' from the beginning. I have a problem with using 'Detect Data Changes'. İf it is checked my dataflow is not refreshed automatically even ETL_Date is increasing.

Kind Regards,
Gökberk Uzuntaş

📌 If this post helps, then please consider Accepting it as a solution and giving Kudos — it helps other members find answers faster!

🔗 Stay Connected:
📘 Medium |
📺 YouTube |
💼 LinkedIn |
📷 Instagram |
🐦 X |
👽 Reddit |
🌐 Website |
🎵 TikTok |

[lbendlin]

Your "hot"  bucket is "1 month".  Change it to "30 days". Then the change detection will only refresh the daily partitions for which the ETL_Date is different.

[uzuntasgokberk]

Hello @lbendlin,

I tried with days too. But it is not changed.

Kind Regards,
Gökberk Uzuntaş

📌 If this post helps, then please consider Accepting it as a solution and giving Kudos — it helps other members find answers faster!

🔗 Stay Connected:
📘 Medium |
📺 YouTube |
💼 LinkedIn |
📷 Instagram |
🐦 X |
👽 Reddit |
🌐 Website |
🎵 TikTok |

[lbendlin · Accepted solution]

If you have a Pro license you can open a Pro ticket at https://admin.powerplatform.microsoft.com/newsupportticket/powerbi
Otherwise you can raise an issue at https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues .

[sfogarty]

How did you go with your raised issue?  Did you get a result?

[uzuntasgokberk]

Hello @sfogarty ,

The ticket has been investigating. 
https://community.fabric.microsoft.com/t5/Issues/Incremental-Refresh-Detect-Data-Changes-Error/idi-p...

Kind Regards,
Gökberk Uzuntaş

📌 If this post helps, then please consider Accepting it as a solution and giving Kudos — it helps other members find answers faster!

🔗 Stay Connected:
📘 Medium |
📺 YouTube |
💼 LinkedIn |
📷 Instagram |
🐦 X |
👽 Reddit |
🌐 Website |
🎵 TikTok |

[uzuntasgokberk · Accepted solution]

Hello @lbendlin,

Incremental refresh in dataflow support in Premium Per User or Premium Capacity. Therefore, I have Premium capacity P1. Thank you for support. I'm going to create a issue.

Kind Regards,
Gökberk Uzuntaş

📌 If this post helps, then please consider Accepting it as a solution and giving Kudos — it helps other members find answers faster!

🔗 Stay Connected:
📘 Medium |
📺 YouTube |
💼 LinkedIn |
📷 Instagram |
🐦 X |
👽 Reddit |
🌐 Website |
🎵 TikTok |