Forum Discussion
Data Mart Version Mismatch
The four articles in this section are covering the topic nicely
Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn
Thank you - Much Appreciated. I will go through them.
What is your rationale for shuffling the data from one Azure data storage (BLOB) to another Azure data storage (datamart) ? What prevents you from consuming the BLOB data directly in the dataset?
Hi lbendlin, Thank you for responding
We use JSON files in the Azure Blob, which does not support M Folding. We want to implement incremental refresh which is supported in Datamarts, but not in the Azure Blob with JSON files.
So I did manage to at least save the initial JSON file upload (no data modelling), but the moment I started any data modelling in Power Query, and tried saving, it would crash on me giving the version error or other errors referring to missing columns (columns which actually exist - this makes no sense).
The Power Query in Datamarts appears to be very sensitive and look for things that do not exist.
BTW - these exact JSON files were successfully unpacked on Power BI Desktop and I followed the exact same sequence I used on PBI desktop, but these errors pop up.
We use JSON files in the Azure Blob, which does not support M Folding. We want to implement incremental refresh which is supported in Datamarts, but not in the Azure Blob with JSON filesIncremental refresh does not mandate that the query folds. You can achieve the same with custom queries.
Oh wow ! I was not aware and none of my research covered custom queries as an option.
Do you have a link you could refer me to so that I can explore this in more detail?
Thank you for your assistance - much appreciated
The four articles in this section are covering the topic nicely
Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn