Forum Discussion
PBI Report loading CSV files behaves strange
Hi tomas12344
Disable Caching: In Power BI Service, turn off "Allow data preview to download during refresh" in Dataset Settings.
Use Folder Partitioning: Organize files into subfolders (e.g., by month/year) to avoid duplication during processing.
Filter Duplicates: Ensure the query excludes duplicate files using logic like Table.Distinct(Folder.Files("FolderPath")).
Enable Incremental Refresh: Configure incremental refresh to process only new or updated data.
Update Gateway: Ensure the gateway is updated and correctly handling file updates.
Did I answer your question? Mark my post as a solution, this will help others!
If my response(s) assisted you in any way, don't forget to drop me a "Kudos" 🙂
Kind Regards,
Poojara
Data Analyst | MSBI Developer | Power BI Consultant
Please Subscribe my YouTube for Beginners/Advance Concepts: https://youtube.com/@biconcepts?si=04iw9SYI2HN80HKS
Thank you for answer, but
- filenames have total different name (core of the name) so that cannot be duplicated
- query caching is disabled on this report as it is set as default
- Filter DuplicatesHow could be this posible, there are no duplicate during the month, only on some day, but when run second time, everything is working correctly. So there could be not duplicates, when nothing changes (no data change, source, code, .... nothing)
- incremental refresh is not posible due the nature of data