Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

Reply
atablkblt1997
New Member

Combing CSV files in dataflow and dataflow does not refresh and grab new csv files.

I have a dataflow that I want to go in to a sharepoint folder and combine all of the csv files in that folder. Each day a new file is automatically added to that folder. I created a dataflow, but the problem is when I refresh the dataflow the number of csv's that it combines is static. So whatever csv files were in the folder when I created the dataflow is what it refreshes. It does not find new csv files. This is the code I am using:

2022-08-23_6-20-46.jpg

 

Any ideas why it won't pick up a new csv file the next day when it moves into that folder?
1 REPLY 1
otravers
Community Champion
Community Champion

What happens when you edit the dataflow and refresh the data preview? Is it possible you have filters in the custom function you're invoking?

------------------------------------------------
1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
------------------------------------------------
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

ArunFabCon

Microsoft Fabric Community Conference 2025

Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.

December 2024

A Year in Review - December 2024

Find out what content was popular in the Fabric community during 2024.