Forum Discussion
Semantic model missing data after refresh from Gen-1 Dataflow
Power BI License:
- PPU
Data Pipeline:
- SQL Server => Gen1 Dataflow (No incremental refresh; Scheduled refresh time @ 6:30am PST that finishes within 10 minutes) => Semantic Model (No incremental refresh; Scheduled refresh time @ 7:30am PST finishes within 30 minutes)
- Scheduled refresh time-zones are correct and aligned
Issue Description:
- Fact tables fail to load all data from source dataflow
- Seems they consistently refresh rows through date(n-2), despite dataflow containing rows through date(n-1)
- Neither dataflow table nor semantic model tables contain date filtering.
- Manually refreshing at both local and service levels does not resolve
- Seems they consistently refresh rows through date(n-2), despite dataflow containing rows through date(n-1)
- After below workaround is performed, issue resolves until next next scheduled refresh cycle
Workaround:
- Perform update to dataflow
- Manually refresh dataflow
- Manually refresh semantic model
Further Troubleshooting:
- Removed single fact table that was impacted by issue at both dataflow and model level, refreshed dataflow and model, published model changes to service
- Re-added fact table to dataflow and model, refreshed both, published changes to service
- Same outcome as workaround, issue appears after next scheduled refresh
Considering the nature of this issue, it seems to be a bug. I began noticing this approximately two weeks ago, before which neither the dataflow nor the model had been altered. MS support has connected with me twice on this issue, and insists that it is not. They recommend that after a dataflow receives a change, that 15 minutes passes prior to refreshing the semantic model. I have put this to the test, and as noted above, the issue repeats during the next scheduled refresh cycle. It seems there are similar user experiences described within this community, so I apologize for any redundancy, but I am hoping to glean some useful feedback beyond getting a shoulder shrug from MS support. Thank you all!
If you have a Pro license you can open a Pro ticket at https://admin.powerplatform.microsoft.com/newsupportticket/powerbi
Otherwise you can raise an issue at https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues .
4 Replies
- lbendlinSuper User
Power BI Service runs on UTC. Check your Power Query code for date/time filters.
- goodbyetontoFrequent Visitor
There are no date-time filters in the query as stated in OP
- lbendlinSuper User
If you have a Pro license you can open a Pro ticket at https://admin.powerplatform.microsoft.com/newsupportticket/powerbi
Otherwise you can raise an issue at https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues .
- goodbyetontoFrequent Visitor
Copied over to the 'Issues' forum. Thx!