Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Did you hear? There's a new SQL AI Developer certification (DP-800). Start preparing now and be one of the first to get certified. Register now

Dataflow issue

Submitted by Anonymous on ‎11-25-2019 04:58 AM

Hi team,

 

I am trying to use dataflow on premium capacity to store daily snapshots from an SQL server. Basically, the data required is to get visibility on some ticketing tool backlog (open tickets at the end of the day). The SQL does have a column date, that is the getdate() for when the SQL is running. 

 

I have configured the below incremental refresh in the dataflow. My expectation is to have data for each day when the SQL is running, however, i only have the last day. Can you please help me with some hints on how i should configure this dataflow?

 

Many thanks!

Theo

 
 
 
 

Capture.JPG

Status: New
See more ideas labeled with:
6 Comments (6 New)
Comments
v-qiuyu-msft
Community Support
Community Support
‎11-25-2019 11:01 PM

Hi @Anonymous, 

 

In your scenario, when you define the incremental refresh policy, please use a different column to define the Detect data changes condition. See: https://docs.microsoft.com/en-us/power-bi/service-premium-incremental-refresh#detect-data-changes

 

q5.PNGq4.PNGq6.PNG

 

Best Regards,
Qiuyun Yu

Anonymous
Not applicable
‎11-26-2019 02:53 AM

Hi Qiuyun,

 

Thanks for your reply. In my use-case, the ticket can be found multiple times in the dataflow result. That is the expected outcome. Since i need to have backlog, then on day 1, ticket id 1, because it's open, will be in the backlog. On day 2, ticket 1 is still open. Due to the incremental refresh, the dataflow should contain twice the ticket id 1, for each day when the ticket was open.

 

I will test the above recommendations and see if this will work.

 

Thanks,

Theo

Anonymous
Not applicable
‎11-26-2019 10:00 PM

Hi @v-qiuyu-msft ,

 

I have performed the changes you suggested and i still only get the last day of data and the previous one is deleted. Any idea on how i can resolve this challenge please?

 

Many thanks,

Theo

v-qiuyu-msft
Community Support
Community Support
‎11-28-2019 10:49 PM

Hi @Anonymous, 

 

I would suggest you create a support ticket to let engineers look into the issue on your side. 

 

Support Ticket.gif

 

Best Regards,
Qiuyun Yu

Anonymous
Not applicable
‎11-29-2019 12:17 AM

Many thanks @v-qiuyu-msft , I will do that. have a good day!

Anonymous
Not applicable
‎11-29-2019 12:53 AM

Hi again,

 

@v-qiuyu-msft , while checking my dataflow before submitting the ticket, i just saw that i have 2 days of data (expected outcome), which means that for now everything seems to be fine. I will continue to monitor it and only raise ticket if needed. Many thanks for all your guidance and help.

 

Have a good day,

Theo

Idea Statuses