topic How to ingest unstructured data (mp3/ pdf) into Fabric? in Pipelines

How to ingest unstructured data (mp3/ pdf) into Fabric?

Charlotte_chum — Mon, 18 Nov 2024 06:28:09 GMT

Hi Everyone,

I am trying to ingest unstructured data (mp3/ pdf) into Fabric by using data pipeline, but not sure how to upload it except using Schema agnostic (binary copy).

Any one know how to upload unstructured data? Mant thanks!

Re: How to ingest unstructured data (mp3/ pdf) into Fabric?

spencer_sa — Mon, 18 Nov 2024 09:32:58 GMT

We have a use case to ingest pdf documents - the way we've done this is firstly via a shortcut to the AWS S3 bucket where they live.
We would then use a schema agnostic (binary) copy process to copy them to the files location of a lakehouse.
I'd then process them from there using a notebook to turn the unstructured data into structured data.

Re: How to ingest unstructured data (mp3/ pdf) into Fabric?

Charlotte_chum — Mon, 18 Nov 2024 11:19:28 GMT

It works!! Thanks 🙂