Forum Discussion
Fabric Data Factory Copy Data Pipeline - recursive excel file processing
Hi Anonymous
Thanks for using Microsoft Fabric Community.
Apologies for the inconvenience that you are facing here.
As I understand that you are trying to load the contents of multiple Excel files with varying worksheet names into a single table using Microsoft Fabric pipeline.
I tried to repro the same scenario and was successful in executing the copy data activity in pipeline without any difficulty. Please find the screenshots for reference.
For doing repro I took 10 sample excel files which are in a directory named as SampleData. Just for reference I took only 3 excel data files and all the excel files have the same data.
Source data:
Copy activity configuration:
Data preview:
Execution details:
Destination:
Here are some common reasons for this error and potential solutions that might help.
- Verify that the column name you are referencing in your query matches the actual column name in the Excel worksheet.
- If your Excel column names contain special characters (such as spaces, hyphens, or other non-alphanumeric characters), it can lead to issues.
- Sometimes refreshing the query or unmerging previously merged columns can resolve issues.
I hope this information helps. Please do let us know if the issue still persists. Glad to help.
Thanks.
During first load, I can able to load the data. However, for second run I added one extra colum to one of the sheet, it is not detecting that column after the copy data activity completion.
Do I need to do anything with the settings?