Hi Microsoft Team
We use Datamart for ETL and modelling in the Power BI cloud against Azure Databricks source. However, I've seen strange issues with Datamart, as listed below.
1) Incremental Load against Azure Databricks Datasource takes very long (around 2 hours), while the full load completes in under 2-3 minutes. The data fetched is minimal, i.e. about 10-15 k rows in total. This is strange behaviour. Would you happen to have any suggestions for me here?
2) One point related to the above is that If I try to use Dataset directly against the Azure Databricks source for import mode, I can see full load timings are similar compared to Datamart. But If I try to use Incremental load, it takes around 35 minutes. So it is much better than Datamart but still high for incremental load considering the data size from the source is very small.
Is there any known issue for the connector used against Azure Databricks source from the Power BI cloud when incremental load configurations are used (especially for Datamart)?
3) Deployment pipelines were configured to move datamart from one workspace to another. It was working fine initially. Few modelling changes were made daily, and at some point, the deployment stopped working for moving Datamart. It is difficult to pinpoint if any specific change made an impact here. The logs do not help to know the issue's cause, description, etc.
Below are the Log IDs generated when the deployment failed. I tried multiple times to deploy again, but it was not working till I deleted the destination Datamart and then deployed again from scratch)
Deployment ID: 57756f55-3b2c-4b5a-babc-1ad7ce900c74
Deployment ID: 32ca5898-944f-4ac0-b159-4c04f97cd770
Deployment ID: 93563e57-72d6-4792-99b7-863ec84b90bc
Deployment ID: e8967b1f-6ef3-4fc0-9124-4b044bf833d7
Deployment ID: 67d42380-f104-4893-9827-135ff3da1876
Could someone from the Microsoft support team review the above logs and confirm the root cause and how to prevent this type of situation in the future using Deployment pipelines?
4) Sometimes, modelling changes in Datamart throws an error when changes are Saved at the Power Query Editor screen (at the time of loading again), and we have to perform the same steps multiple times to get it done. This is becoming a pain to plan things for future reporting via Datamart usage.
At one point, Datamart gots corrupt, i.e. it was not clickable, and error message was saying that the connection between Dataset and Datamart had been lost and to wait for a couple of seconds. But it does not work or get clickable again even after a good number of days. Is it a Known bug?
I know I've put multiple things in the same thread, but all these are about Datamart and related ones with each other. I am so using same thread to list them out all here.
Regards
Rohit
