Editing/Adding columns in a Dataflow, Datamart is not refreshing.

[aj1973]

Hi,

I built a Datamart on top of Dataflow (Source = PowerPlatform.Dataflows([])). When I add a column to the Dataflow, Publish and refresh it, nothing changes into the Datamart nor the default Dataset of the Datamart ! The added column is not in the Datamart.

To see the update in the Datamart and its default Dataset, I had to open Power Query of the Datamart and refresh all the Applied steps one by one (Query settings) and Save it. My new added column is now in the default dataset.

Is this a normal behavior? 

[Anonymous]

Hi  @aj1973 ,

It would be great to have a detailed picture to describe your problem.

Can you provide detailed version information so we can reproduce the issue? please also tell us which browser is being used.

Thanks in advance!

Best regards.
Community Support Team_Caitlyn

[aj1973]

@Anonymous 

Browser Edge as always.

Fabric Trial, Premium Workspace.

First I created a Dataflow without the ContactName Column and Published

then created the Datamart from Dataflow

and a default Semantic model was created as well

All was good up till then.

Now I went back to the Dataflow and added the column ContactName and Published

Opened the Datamart and the semantic model and the column still not there

waited for 15 mins and refreshed the Dataflow and the Datamart and still the column in the Datamart nor the Dataset.

Opened again the Datamart  and Transform Data, clicked on these steps one by one

and the column appeared. Saved and opened the Dataset, the column ContactName appeared also.

By the way this issue was first raised by someone else in this thread

Re: Is it possible to refresh a semantic model in ... - Microsoft Fabric Community

Thank you.

Amine

[SOSPBI]

Hello,

I'm not sure what the typical pace is for suggestions like this, but I'm just checking in to see if @Anonymous  has any reply to the second description by @aj1973.

With thanks.

[SOSPBI]

Dear @aj1973 

I am trying to use your approach as a work-around.  However, when I add a new column to my DataFlow, and then open up the Query Settings of the DataMart and try to Save, I am given an error in the "Wrapping Things Up" stage.  It reads:

Wrapping things up

DatamartReferencedEntitySchemaChangedException

• ErrorMessageDataflow entity referenced by table 'Grant Requests (No Filters)' changed its columns. Please update the datamart.
• HttpStatusCode400

• Status code500
• Error CodeDatamartReferencedEntitySchemaChangedException

Do you have any advice?  Thank you.

[aj1973]

@SOSPBI 

Did you first refresh the Datflow?

[SOSPBI]

Thank you @aj1973 

Yes, I did.   

Update: Hello @aj1973.  I tried again, and this is what I have found.  If I open the DataFlow and add a new column to the PowerQuery, then I must save and refresh the DataFlow.  Then, I must not refresh the DataMart right away.  Instead, I must open the DataMart and go to "Transform", and click through each of the steps of the Query, as you described.  Then the new column will appear in the Report builder.  And then I can refresh the DataMart without getting the error.

[Dawid_Wojakowsk]

Hello,

I had the same problem in Datamart. I have added to my Sharepoint located CSV file additional column, even though I tried to refresh Datamart it did not work out. I went to query and edit query and tried to refresh the preview, it did not fix the problem for me. I had a very long list of changes. This additional column was not seen. Only creating the query once again helped. Precisely I had to choose once again the source and come to point I could see all columns, then I used the Query Advanced editor to copy the rest of the transformation to new query, not to create them manually once again. Hope it helps to someone.