Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

Reply
Anonymous
Not applicable

Data pipeline to download zip file containing multiple csv files from web

I am attempting to create a pipeline or pipelines to do the following:

6 REPLIES 6
Ostrzak
Helper II
Helper II

Upvoting the question. I have a similar problem, where pipeline is extracting the csv file, but there are some parsing errors.

Anonymous
Not applicable

I would really like a data pipeline solution to this.  It seems like the ability to unzip delimitated files is built-in, but it fails due to the lack of proper handling of multiple files in the zip.  I would love to see a pipeline procedure that unzips multiple files to the Files folders.  Other pipelines would process the csv and combine them.  Any chance that notebooks could solve my problem?

Anonymous
Not applicable

I am attempting to create a pipeline or pipelines to do the following:

The problem is that when I unzip the file into delimited format, there is no way to unzip multiple files to the Files/CSV folder.  The get data in the pipeline wants to create a single file.  I have attempted to go directly from binary zip to table, but the procedure gives me an error because the two CSV are not in the same format. 

 

I am looking for help on the unzip pipeline into multiple CSV files.

You should be able to do this in a Gen2 Dataflow, following tackytechtom's answer from https://community.fabric.microsoft.com/t5/Power-Query/zipped-file-how-to-unzip-in-power-query-more-e... 

 

Run the function with your url and then you can create separate queries in Power Query for each CSV file.

Hi @Anonymous 

 

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.


Thanks.

Hi @Anonymous 

 

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
If you have any question relating to the current thread, please do let us know and we will try out best to help you.
In case if you have any other question on a different issue, we request you to open a new thread.


Thanks.

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Dec Fabric Community Survey

We want your feedback!

Your insights matter. That’s why we created a quick survey to learn about your experience finding answers to technical questions.