Incremental refresh from Azure DataLake

[kadapavel]

Hello everyone,

I'm having diiculty to deploy Power bi reports to my clients due to slow download process(1 day 2M rows of data),

as a solution wanted to use incremental refresh, but.. My data is partially in Azure SQL and mostly in Azure DataLake.

As one test trial I used as source only DataLake query and succesfullly pulished report with right setting of parameters RangeStart, RangeEnd etc.. but even report is in Premium workspace refresh is not working.

"You can't schedule refresh for this dataset because the following data sources currently don't support refresh:

• Data source for PolicyBased_36686F87_B3FA_4760_A613_9C6D47A37170
• Data source for Partition_36686F87_B3FA_4760_A613_9C6D47A37170

Discover Data Sources

Query contains unknown or unsupported data sources."

I would appreciate for any possible solutions or suggestions.

BR

Pavel

[v-shex-msft · Accepted solution]

HI @kadapavel,

Is there any advanced operation in your query tables? (e.g. combine, append, invoke custom functions...)

AFAIK, current power bi service side not support scheduled refresh on datasource which used custom functions or had datasource who mix 'on premise' and 'online' datasources.

Regards,
Xiaoxin Sheng

[kadapavel]

Hi Xiaoxin,

Thanks for reply. Yes I use parameters in functions, then invoke them.

Hopefully the refresh will be available one day. Currently I plan to make subrefresh:).

Combining old data with new by using parameters