BinaryBotany's avatar
BinaryBotany
Icon for Helper I rankHelper I
2 years ago
Status:
Needs Info

Incremental load no longer working with deployment pipelines

The latest October 2023 release seems to have broken the incremental load process when using deployment pipelines. 

 

How it use to work:

1. Deploy report with incremental load correctly set up to a DEV environment

2. Refresh the dataset in DEV or not, it doesn't matter.

3. Deploy report to PROD environment using PBI deployment pipeline

4. PBI service would refresh the PROD dataset to make sure the history partition is loaded, as well as the incremental partition.

5. A nightly refresh would refresh only the incremental partition, as expected.

 

Following that same procedure post October update, and the historical partition never loads (manual or scheduled trigger).

 

I have tried refreshing the dataset in the DEV environment, and it loads the history. However, when deployed the PROD, it does not include or load the history.

 

It appears that the logic that tells PBI service to treat the deployment to PROD as a new upload (thus kicking of the loading of history) no longer exists.

 

This is a pretty big deal, as it means all our incremental datasets need to be published directly to PROD, forcing us to bypass our testing procedures.

 

Please investigate and fix ASAP.

2 Comments

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi  BinaryBotany 

    If you re-create a simple incremental refresh in Desktop and deploy it in pipeline, will you have the same problem?

     

    Best Regards,
    Community Support Team _ Ailsa Tao

  • After much experimentation, I have concluded that either:

    • the issue was transient, OR
    • the issue is fixed, OR
    • I was the problem

    You can close this ticket.