How to copy multiple csv files from Lakhehouse folder to Warehouse using copy activity?

[Sean500]

Hi

I have multiple CSV files gets stored in Lakehouse. My lakehouse name is S&P-500, see below screen shot

CSV file gets stored every day. I need to copy these files into warehouse using copy activity

I don't how to give in the file path. Can anyone help?

[ajarora · Accepted solution]

To set schema mapping, you can specify a single csv file first, and after setting the mappings, unset the file name setting.

As long as all csv files have same schema, the csv files should get copied into warehouse table.

[ajarora]

You can leave the file name empty, to indicate that all files in the folder will be copied.

Alternatively you can filter the files to be copied in a folder based on modified time. This setting is in the Copy activity -> Source -> Advanced.

[Sean500]

Thanks @ajarora 

When I leave the file name empty I am getting below and unable to do the mapping

My plan is to load every day alll the files by truncate table in pre script in the destination warehouse. I tried wildcard path as well by giving *.csv in the file name but it is not recognizing.  Please advise