Forum Discussion
Incremental Load with SQL & Network located excel files
- 1 year ago
Mohan128256 , If you are a power BI user, not fabric.
Power BI With DataFlow
Append All the Excel in one data flow
Then you can load the SQL server in Power BI File and then append it with table that you load from SQL server
The same can be done in one dataflow or power Query (Desktop) too
In the case of Fabric, I can load data in One Dataflow Gen2. If needed I can append data in SQL or pySpark based on destination.
Hope this can help
- 1 year ago
- Create a dataflow for your Excel data
Combine all 3 sheets in the dataflow
Set up scheduled refresh for the dataflow - Implement incremental refresh on SQL table directly
Use RangeStart and RangeEnd parameters - Load data from dataflow (Excel data)
Load incrementally refreshed SQL data
Append these two sources
💌 If this helped, a Kudos 👍 or Solution mark would be great! 🎉
Cheers,
Kedar
Connect on LinkedIn - Create a dataflow for your Excel data
Mohan128256 , You can set up incremental for SQL server based on dates. But I doubt you can do that for Excel.
Also, you should make sure you refresh data in service, not on desktop
https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview
Power BI Incremental Refresh Pro; Premium Deployment pipeline - https://youtu.be/nIxTRdeCYSE
Check Suggestions from GuyinCube to reduce the load
https://www.youtube.com/watch?v=qZOEDBedATA