Data Pipeline copy data filename wilcards

[Lukemattestor]

I have a Data Pipeline the source is pointing to an azure blob storage folder and destination is a lakehouse file.

The file i'm trying to pickup from the azure blob storage will have different date timestamp each day so for example myfile_YYYYMMDD.csv, so i've put myfile_*.csv into the filename part of my filepath but it cant seem to pick up the file. If i hard code the filename the pipeline picks up the file.

Any ideas how i can add filename wildcards into the data pipeline?

[v-sathmakuri]

Hi @Lukemattestor ,

I hope this information provided is helpful. Feel free to reach out if you have any further questions or would like to discuss this in more detail. If responses provided answers your question, please accept it as a solution so other community members with similar problems can find a solution faster.

Thank you!!

[v-sathmakuri]

Hi @Lukemattestor ,

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If the responses has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you!!

[v-sathmakuri]

Hi @Lukemattestor ,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

[v-sathmakuri · Accepted solution]

Hi @Lukemattestor ,

Thank you for reaching out to Microsoft Fabric Community.

If you are using fabric pipelines to move data from blob storage to a lakehouse, select the File path type as Wildcard file path in the source. In the first tab, provide the full path and use myfile_*.csv for the wildcard file name. Set the file format to DelimitedText. Please find the screenshot below for reference. I tried this solution and the file was successfully picked up.

If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it! 

Thank you!!