Forum Discussion
Help, about setting up data.
Hello everyone, I'm pretty new at PBI, so basically what I need help for is setting up my data so i can do scheduled refresh without problem. I have a lot of rows 4-5 mil. I'm pulling some of them ...
Yes, sounds like incremental refresh is the better option here. It would eliminate your intermediate step with the CSV files.
You can also emulate incremental refresh by creating your own "partitions" with the CSV files. As long as all CSV files are in the same sharepoint/Onedrive folder and have the same structure you can write Power Query code that automatically appends them all into a single data source.