How to load individual CSV files from URL

[jmg80525]

Greetings:

Looking for a little insight to see if I can combine CSV files that are publically exposed on a web page.  (https://ecmc.state.co.us/data2.html#/downloads under the Production Data>All Production Reports Received By Year).  Each CSV has a URL link where the link will only differ from one year to another by the year itself.  I understand I could download the files into a folder with Power Flow and then use the Folder.Connect function, but I was hoping to bypass that step and build a dataflow that combines all the CSV files with a single transformation. Something with a table or parameters that would loop through the year domain and continue to load the CSV files into a single query.  Thanks in advance. 

[MattAllington]

To complete a file combine you need an address for the source files and a list of file names. If you are doing file combine from your pc, PQ can generate the list of files for you. You may or may not be able to generate the list of files from the web, you have to check it out. Just

get file

from web

when the wizard launches, right click the yellow folder icon in the wizard and select "transform data". If the list of files isn't available, you can create one yourself or load one from Excel. This assumes you know the file names, of course.