topic extract data into OneLake using Fabric in Pipelines

extract data into OneLake using Fabric

esraaE — Sun, 14 Jul 2024 14:50:49 GMT

I have a collection of PDFs from various sources and need to extract data into OneLake using Fabric.
How can I do that? Are there any documentation or steps I should follow?

Re: extract data into OneLake using Fabric

Anonymous — Mon, 15 Jul 2024 01:59:16 GMT

Hi esraaE

First extract the data, you might consider using a tool or library to extract the data from the PDF.

After extracting the data, you may need to clean the data and convert it into a suitable format (for example, CSV, JSON) to load into OneLake.

Here are some information about connecting to onelake:

How do I connect to OneLake? - Microsoft Fabric | Microsoft Learn

Options to get data into the Lakehouse - Microsoft Fabric | Microsoft Learn

Access OneLake with Python - Microsoft Fabric | Microsoft Learn

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: extract data into OneLake using Fabric

NandanHegde — Mon, 15 Jul 2024 03:13:59 GMT

Assuming the sources are supported by either Dataflow Gen 2 or datapipelines, you can extract data from PDF via dataflow Gen 2 .

Below blog explains the same:

https://datasharkx.wordpress.com/2023/12/03/read-and-import-data-from-pdf-file-using-msft-fabric/

Re: extract data into OneLake using Fabric

esraaE — Wed, 14 Aug 2024 21:22:49 GMT

How can I write to my Fabric Lakehouse via external app or Systems?

We are currently integrating multiple systems and need to push files directly into the Fabric Lakehouse. However, we would like to avoid using notebooks or pipelines for this process. Additionally, we anticipate adding more systems in the future and want to ensure the solution can scale accordingly.

Could you please advise on the best approach to achieve this?