Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
3 years ago

Incremental Refresh initial load in Power Query Editor

For Incremental Refresh, I found initial we have to load full data in Power Query Editor, in my datasource table. There are millions of records so it is not possible to load entire data. Is there any...
Need Help
Show and Tell
LP280388's avatar
LP280388
Resolver II
3 years ago

Anonymous 
In one of our cases, I did similar approach to not to load all data in powerbi desktop.  In the below code I have set the parameter with True/false value. You can create a similar parameter with "NoOfRecords" and then implement your incremental refresh and publish.  Change the parameter value in the PowerBI Services. 

Following these steps we did:

 

  1. Create a Test Parameter in Dataset called NoData and set it to True
  2. Insert the following condition in all Tables MQuery :

#"DataCheck" = if Text.Contains(NoData,"True") then Table.RemoveLastN(CUSTOMER_Table,(Table.RowCount(CUSTOMER_Table))) else Table.RemoveLastN(CUSTOMER_Table,0)

 

This will truncate all data from the tables.

  1. After publishing the dataset, goto Dataset Settings > Parameters and change the Value of NoData parameter to something else.

The above is not a straight answer to your question, but a good opportunity to take this as a reference and implement your own version 🙂