topic Re: External Table on Folder with Excel File / Folder in Pipelines

External Table on Folder with Excel File / Folder

ipkus — Tue, 08 Oct 2024 18:42:32 GMT

I have a folder shorcut where we will store excel file with multiple tabs. New files will be added each week.

Can we create an external table that points to this folder shortcut and reads the content ? New files will be added each week. If we are able to create an external table then in theory we will see new data when new files are added.

Re: External Table on Folder with Excel File / Folder

Anonymous — Wed, 09 Oct 2024 08:44:50 GMT

Hi ipkus ,

You can try creating a data pipeline using Data Factory to read Excel files from a folder. Configure the pipeline to run on a schedule to ensure it picks up new files as they are added.

Best Regards,
Adamk Kong

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: External Table on Folder with Excel File / Folder

charlyS — Wed, 09 Oct 2024 09:54:25 GMT

Hello,

Shortcut will expose folders as tables only if they contain delta lake files in it (or iceberg in some case).

If you want to have you'r file as a table you will need to transform it using one of the multiple tools available (Dataflows, Pipelines, Notebooks), but it will not be a shortcut or "live" it will be a copy of the data after the extraction and load process will be executed.

Hope this help,