Persisting List

[Anonymous]

Hi All,

I'd like to do some incremental refresh, and i've been thinking about this:

2 tables, the one with the initial set and the second one with the increment.

I convert both of them to List, combine both list into the initial.

It does the combine but don't save the datas in the table.

Here's the code:

let
    SQL = "....",
    Source = ...,
    #"Changed Type" = Table.TransformColumnTypes(Source,{....),
    #"RefreshToList" = Table.ToList(#"Changed Type"),
    Datas = List.Combine({#"RefreshToList", Datas}),
    #"Converted to Table" = Table.FromList( Datas, Splitter.SplitTextByDelimiter(","), null, null, ExtraValues.Error),
    #"Renamed Columns" = Table.RenameColumns(#"Converted to Table",{...),
    #"Changed Type1" = Table.TransformColumnTypes(#"Renamed Columns",{...})
in
    #"Changed Type1"

 Datas is the initial set list and it's not been persisted, why ?

Thanks,

Christopher

[TeigeGao]

Hi @Anonymous ,

We cannot setup the incremental refresh using PowerQuery directly, List.Combine requires multiple dataset, but in your scenario, we can't use the Datas as the sataset. When we click the Refresh Preview button, the full dataset will be refreshed.

Actually, PowerBI Service provides the incremental refresh feature for Premium user, please refer to this blog: https://powerbi.microsoft.com/en-us/blog/incremental-refresh-in-power-bi-premium/

Best Regards,

Teige

[Anonymous]

Hi @TeigeGao,

Thank you for your reply.
I can't currently use the Premium feature and to be more specific about my case, the initial data (called Datas in my code) is not included in the report refresh, to avoid precisely that its content is cleaned up during an update.

I've been thinking to another thing:

- Doing my refresh to get my increment

- In Datas, I'm using func.InvokeAfter(f, #duration(....)) to delay the execution of the combine after the load of the increment but it gives me a circular reference error because it execute again the script when you use it's name.... 😞

I've seen something in Excel doing this but it's seems that it doesn't work in Power BI Desktop....

So if anyone have an idea 😉

Thanks,

Christopher