Forum Discussion

Mohan128256's avatar
Mohan128256
Helper IV
1 year ago
Solved

Incremental Load with SQL & Network located excel files

Hi All,   I am trying to implement Incremental refresh on tables where A table is coming from SQL source and B is a excel table which is placed over a network location.   B excel file has 3 diffe...
  • amitchandak's avatar
    amitchandak
    1 year ago

    Mohan128256 , If you are a power BI user, not fabric.

    Power BI With DataFlow

     

    Append All the Excel in one data flow

    Then you can load the SQL server in Power BI File and then append it with table that you load from SQL server 

     

    The same can be done in one dataflow or power Query (Desktop) too

     

    In the case of Fabric, I can load data in One Dataflow Gen2. If needed I can append data in SQL or pySpark based on destination.

     

    Hope this can help

  • Kedar_Pande's avatar
    1 year ago

    Mohan128256 

     

    1. Create a dataflow for your Excel data
      Combine all 3 sheets in the dataflow
      Set up scheduled refresh for the dataflow
    2. Implement incremental refresh on SQL table directly
      Use RangeStart and RangeEnd parameters
    3. Load data from dataflow (Excel data)
      Load incrementally refreshed SQL data
      Append these two sources

    💌 If this helped, a Kudos 👍 or Solution mark would be great! 🎉
    Cheers,
    Kedar
    Connect on LinkedIn