Forum Discussion
Incremental data load from CSV
According to this article, no:
https://docs.microsoft.com/en-us/power-bi/service-premium-incremental-refresh
Limitations
Currently, for composite models, incremental refresh is supported for SQL Server, Azure SQL Database, SQL Data Warehouse, Oracle, and Teradata data sources only.
Sometimes the documentation is out-of-date though.
- Anonymous6 years agoNot applicable
Yes, Greg_Deckler is correct...
BUT, you can use the same M code and create a Dataflow. Dataflows DO enable incremental refresh on sources like .csv flat files.
When the dataflow refreshes, it will only pick up the newest data, perform the transformations, and load that newly shaped data into the Azure Data Lake.
If you do all of your transformations in the dataflow, the Power BI just has to read from the Data Lake to pull data into the model. That read is usually much faster than reading from .csv files in SharePoint and performing transformations.
I'm pretty sure you can also enable incremental refresh for pulling data from the dataflow.
Best,
~ Chris