Design for Excel Load, Transformation and Export Pipeline

[huntergatherer]

Hi, 

I am new to Data Factory on Fabric and would know the best approach to solve the following issue: 

we have a large Excel file that gets updated every couple of months, located on SharePoint. We need to run data transformation jobs (generating new columns based on conditions in the exsting columns) and export the newly created columns to an Excel file that can be downloaded. What would be an easy way to implement this?

Any suggestion is highly appreciated!

[AbiNyk]

Hi,

How did you connect and send files back to Sharepoint ? I am also in the process 🙂 

[huntergatherer]

Thank you @NandanHegde , very helpful input.

[NandanHegde · Accepted solution]

Hey,

Couple of things :

1) Data pipelines within data factory support data movements and dataflow control as is.

In case if you need to do major data transformations, then you need to leverage Dataflow Gen 2 and integrate it within the pipelines

2) Also data pipelines/dataflow gen 2 doesnt support Excel file type as a sink.

So in case if you want to export the data as an excel file, you would have to either use custom coding via Notebook or use other offerings like Logic apps etc