Forum Discussion

jasperj101's avatar
jasperj101
Helper I
1 year ago
Solved

Scheduled Refresh Not Pulling New Data

Good Afternoon All,    I have a scheduled refresh of a 2 daily dataflows followed by a scheduled refresh of a semantic model that pulls data from these flows.    I noticed that the data in the da...
Dataflow
  • jasperj101's avatar
    jasperj101
    1 year ago

    Hi All, 

     

    Just to confirm this is now fixed, by changing the timings of the scheduled refresh for both the dataflow and dataset (I shifted them both forward by 30 minutes) this fixed the issue. 

     

    However, I have no idea why this issue occured and the scheduled refreshes were pulling in old data from a fixed point in time without erroring... Any explanatgions would be muich appreciated. 

     

    Thanks, 

    J

Anonymous's avatar
Anonymous
Not applicable
1 year ago

Thanks for Tutu_in_YYC's concern about this issue.

 

Hi, jasperj101 

Do you currently have this problem?
May I ask how you determined that the data was not refreshed?
Have you tried clearing your cache or changing your browser?


Also you can try to recreate a semantic model with the same data stream and configure Scheduled refresh in a different workspace to check if the problem still exists.

 

 

 

I hope my suggestions give you good ideas, if you have any more questions, please clarify in a follow-up reply.
Best Regards,
Fen Ling,
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

jasperj101's avatar
jasperj101
Helper I
1 year ago

Hi, 

 

I am still having this issue, in fact it has gotten worse. On Friday I manually refreshed the flow and model which pulled in the recent data up to 08/11. A scheduled refresh then occured this morning (11/11) on the flow and then the model as per the below timings. The data has REVERTED back to the old data from 02/11! 

 

The model is stored and processed on an F128 capacity premium license. 

 

The data was found out as outdated by looking in the model to find most recent date in the source table that this dataflow is creating. Other dataflows connected to this model with schedule refreshed are working fine, it is just this one. All of our dataflows connect to Dataflow Gen1 (source data in this location is definitely up to date) 

 

Thanks, 

J

  • jasperj101's avatar
    jasperj101
    Helper I
    1 year ago

    Hi All, 

     

    Just to confirm this is now fixed, by changing the timings of the scheduled refresh for both the dataflow and dataset (I shifted them both forward by 30 minutes) this fixed the issue. 

     

    However, I have no idea why this issue occured and the scheduled refreshes were pulling in old data from a fixed point in time without erroring... Any explanatgions would be muich appreciated. 

     

    Thanks, 

    J