Sharepoint list to Fabric

[Msoede]

Hi,

We have various project sites (Sharepoint) each containing a fixed sharepoint list with data.

For each site we would like to be able to trigger a flow that takes the Sharepoint list and uploads the data into a fabric lakehouse.

Has somebody experience with such an ETL process (how to achieve this)?

Many thanks for your input.

Regards, 

Michiel 

[Msoede]

Thanks both. Do you it would be feasible to trigger such a flow from the Sharepoint site itself, parsing the specific list to the flow (so that the flow in such a way should be dynamic)? 

[Anonymous · Accepted solution]

Hi @Msoede,

Thank you for reaching out in Microsoft Community Forum.

Thank you @NandanHegde, @ObungiNiels  for the helpful response.

Please follow below steps to acheive this;

1.Use Power Automate to trigger the flow when an item is added or modified in a SharePoint list.

2.Fetch data from the specified SharePoint list using dynamic parameters (site URL, list name) passed from the flow.

3.Apply transformations within Power Automate or later in Fabric Lakehouse.

4.Use Data Pipelines or Dataflows to load the data from SharePoint into the Lakehouse.

Please continue using Microsoft community forum.

If you found this post helpful, please consider marking it as "Accept as Solution" and give it a 'Kudos'. if it was helpful. help other members find it more easily.

Regards,
Pavan.

[NandanHegde]

You can use Fabric data pipelines and leverage copy activity within it with Sharepoint list as a source and sink as the fabric lakehouse

[ObungiNiels]

Hi @Msoede ,

explicitely for sharepoint data, we've had success with Dataflows Gen2, since they offer a proper connector to sharepoint which we were lacking in data pipelines at the time. However, these were sharepoint files, which are unavallable as connector in data pipeline. 

Since you are dealing with sharepoint lists, it is also possible to use a copy acitvity in a data pipeline. Sharepoint online lists are available as source and can also be used with a service principal. 🙂 

Hope this helps! 

Kind regards,

Niels