Incremental table

[kevinEGE]

Morning!!

I created a null request on powerbi with the information of an Blubble.io API. It gives me: Cursor (Means the data "ID", like 1, 2, 3..), Results in a list format, Count of itens showed and itens remaining, like this:

With this data, i manage to created the code bellow:

[

letFonte = Json.Document(Web.Contents("https://X" & "?api_token=Y")),
#"Convertido para Tabela" = Table.FromRecords({Fonte}),
#"response Expandido" = Table.ExpandRecordColumn(#"Convertido para Tabela", "response", {"cursor", "results", "count", "remaining"}, {"response.cursor", "response.results", "response.count", "response.remaining"}),
#"Colunas Não Dinâmicas" = Table.UnpivotOtherColumns(#"response Expandido", {}, "Atributo", "Valor"),
Paginação = List.Numbers(0, Number.RoundUp((#"Colunas Não Dinâmicas"{3}[Valor] + #"Colunas Não Dinâmicas"{2}[Valor]) / 100), 100),
#"Convertido para Tabela1" = Table.FromList(Paginação, Splitter.SplitByNothing(), null, null, ExtraValues.Error),
#"Tabela Incremental" = Table.AddColumn(#"Convertido para Tabela1", "Column2", each Json.Document(
Web.Contents(
"https://X",
[
RelativePath="/x",
Query=
[
cursor=Text.From([Column1]),
api_token="Y"
]
]
)
)),
#"Column2 Expandido" = Table.ExpandRecordColumn(#"Tabela Incremental", "Column2", {"response"}, {"Column2.response"}),
#"Column2.response Expandido" = Table.ExpandRecordColumn(#"Column2 Expandido", "Column2.response", {"cursor", "results", "count", "remaining"}, {"Column2.response.cursor", "Column2.response.results", "Column2.response.count", "Column2.response.remaining"}),
#"Column2.response.results Expandido" = Table.ExpandListColumn(#"Column2.response Expandido", "Column2.response.results"),
#"Column2.response.results Expandido1" = Table.ExpandRecordColumn(#"Column2.response.results Expandido", "Column2.response.results", {"Columns"}),
#"Tipo Alterado" = Table.TransformColumnTypes(#"Column2.response.results Expandido1",{{"NameColumns}})
in
#"Colunas Renomeadas"

]

But this code always check all data from the database, wich means that for a lot of data this will take a lot of time.

Im trying to modificate this, in a way that the BI just take the data starting from the last row, without consult all the data before this point.

anyone can help? 

[amitchandak]

@kevinEGE , have you checked incremental refresh in power bi

Power BI Incremental Refresh Pro; Premium Deployment pipeline - https://youtu.be/nIxTRdeCYSE

https://docs.microsoft.com/en-us/power-bi/admin/service-premium-incremental-refresh