Forum Discussion
Incremental Load with SQL & Network located excel files
Mohan128256 , If you are a power BI user, not fabric.
Power BI With DataFlow
Append All the Excel in one data flow
Then you can load the SQL server in Power BI File and then append it with table that you load from SQL server
The same can be done in one dataflow or power Query (Desktop) too
In the case of Fabric, I can load data in One Dataflow Gen2. If needed I can append data in SQL or pySpark based on destination.
Hope this can help
- Create a dataflow for your Excel data
Combine all 3 sheets in the dataflow
Set up scheduled refresh for the dataflow - Implement incremental refresh on SQL table directly
Use RangeStart and RangeEnd parameters - Load data from dataflow (Excel data)
Load incrementally refreshed SQL data
Append these two sources
💌 If this helped, a Kudos 👍 or Solution mark would be great! 🎉
Cheers,
Kedar
Connect on LinkedIn- Create a dataflow for your Excel data
amitchandak thanks for finding the time to reply.. Been a fan of your content.
Can i be able to do it by having these excel files appending in dataflow and then in power bi model append the dataflow to sql table data together?
Will that work? any thoughts.?
Thanks,
Mohan V.
Mohan128256 , If you are a power BI user, not fabric.
Power BI With DataFlow
Append All the Excel in one data flow
Then you can load the SQL server in Power BI File and then append it with table that you load from SQL server
The same can be done in one dataflow or power Query (Desktop) too
In the case of Fabric, I can load data in One Dataflow Gen2. If needed I can append data in SQL or pySpark based on destination.
Hope this can help
amitchandak what i understood from your reply is.
1. Create dataflow with excel file which has 3 sheets, append it in dataflow
2. Load SQL table in power bi desktop, implement incremental refresh
3. Using Power Query append DataFlow table to SQL table together.
Please correct if it is not the approach you are suggesting.
Thanks,
Mohan V.