Forum Discussion

vitoriamariabr's avatar
vitoriamariabr
Frequent Visitor
2 years ago

Incremental Refresh Azure Blob

Hi, I need help implementing incremental refresh on Azure Blob databases. I've already implemented it the standard way, but the incremental refresh takes forever and sometimes it doesn't even update, I don't think it's working correctly. I implemented it the basic way, creating the parameters and filtering RangeStart and RangeEnd in my date column (in azure blob the date column I used was Date modified) and I also tested it by inserting the incremental refresh filtering directly in the source:


"let
startDate = RangeStart,
endDate = RangeEnd,
Fonte =Table.SelectRows(AzureStorage.Blobs("https://xxxxxxxxx.blob.core.windows.net/xxxxx"),each [Date modified] >= startDate and [Date modified] <= endDate)".

However, the incremental update still doesn't work correctly. Can anyone help me?

 

 

olá! Preciso de ajuda para implementar atualização incremental em bases do Azure Blob. Já implementei da forma padrão, porém a atualização incremental demora uma eternidade e às vezes nem chega a atualizar, não acho que esteja funcionando corretamente. Cheguei a implementar da maneira básica, criando os parâmetros e filtrando RangeStart e RangeEnd na minha coluna de data (no azure blob a coluna de data que usei foi o Date modified) e testei também inserindo a filtragem da atualização incremental direto na fonte:

 

"let
startDate = RangeStart,
endDate = RangeEnd,
Fonte =Table.SelectRows(AzureStorage.Blobs("https://xxxxxxxxx.blob.core.windows.net/xxxxx"),each [Date modified] >= startDate and [Date modified] <= endDate)".

Porém, ainda assim a atualização incremental não funciona corretamente.

Alguém saberia me ajudar?

5 Replies

  • RangeStart and RangeEnd cannot be both inclusive.  Usually RangeStart is inclusive and RangeEnd is exclusive.

    You cannot use Date columns, it must be DateTime or DateInteger.

    • vitoriamariabr's avatar
      vitoriamariabr
      Frequent Visitor

      I see. My column is a DateTime. I'll adjust the RangeStart and RangeEnd, but I don't think that's the problem.

      • lbendlin's avatar
        lbendlin
        Super User

        What is your reasoning for doing this in the first place?