Forum Discussion
PowerQuery Issue
Hello,
We use “AzureStorage. Blobs” to get the data from the data lake, but we meet some problems：
1. When the data source in the data lake is updated, sometimes it is an empty data source;
2. As the data sources in the data lake become larger and larger, the refresh speed becomes slower and slower.
1 Reply
Murtaza_GhafoorSuper User
Hi ccxcsz2,
In first instance it is quite possible that when the data overwrite in blob storage, the power query trigger at the same time. You need to make sure the Power Query triggers after the backend overwrite operations complete.
For second instance, the reason for slower refresh is because, the data files grows more and more in size and data load becomes heavy so instead loading the whole data again, you must consider the incremental refresh in power BI.
If possible, a better approach is to expose curated/Delta tables to Power BI instead of repeatedly scanning raw Data Lake files.
If this helps, ✓ Mark as Kudos | Help Other