Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
7 years ago

Does incremental refresh work with azure table storage ?

Does incremental refresh work with azure table storage ?

3 Replies

    • Anonymous's avatar
      Anonymous
      Not applicable

      Hello,

       

      I would like to get a definite answer to that as well. I have tried setting up incremental refresh for an Azure storage table source but it doesn't seem to be working, even if it supports parameter-based filtering. Consider the following query:

      TableSource = AzureStorage.Tables(ParamTableUrl),
      TableSourceTelemetry = TableSource{[Name = ParamTableName]}[Data],
      TableSourceTelemetryFiltered = Table.SelectRows(TableSourceTelemetry, each ([PartitionKey] = ParamTenantName and [Timestamp] >= RangeStart and [Timestamp] < RangeEnd))

      When doing this, I can see when inspecting the network traffic that the query made to the table storage API includes the timestamp-based filters, so there is some kind of query folding going on and the data is nicely filtered server-side. However,

      when I right-click on the last step in the query the "View Native Query" option is disabled, and when configuring the incremental refresh for the table I do get the "Unable to confirm if the M query can be folded. It is not recommended to use incremental refresh with non-foldable queries." warning.

       

      When I publish the file, the Power BI service just seems to be using the values of RangeStart and RangeEnd that were saved instead of replacing them based on the incremental refresh settings.

       

      It would be nice if someone could confirm whether this is supposed to work or not.

      • Anonymous's avatar
        Anonymous
        Not applicable

        Anonymous I am stuck at same issue, Did you reach to any conclusion