Forum Discussion
Problem with semantic model refresh after data transformation in Data Flow Gen2
- 2 years ago
Hello DALI007 ,
check out this post, maybe it'll help :
Re: How can I update the PowerBi semantic model sc... - Microsoft Fabric Community
Hey!
I am not sure I completely follow. How was the table in your destination (LakeHouse) created? Are you able to check the schema to see what data types it requires and that is bound to?
is the dataflow inserting the right values according to the definition of the schema of the lakehouse table that you see in the lakehouse experience and table browser?
- DALI0072 years agoHelper II
Hello Miguel,
I inserted the first time a table (a schema ) which does not contain the last column "type_site". But after a transformation I wanted to insert a new table that will replace the existing table with the addition of this new column "type_site". I do not know if this action is possible to do it automatically by just updating the semantic model or I must manually delete the old table and insert the new table again. I hope I was clear in my explanations.
Thank you in advance for your return- miguel2 years agoCommunity Admin
Hey!
Im not sure I follow. You mention a semantic model, a Lakehouse and a DataflowGen2.
The Dataflow Gen2 cannot load data directly to a semantic model. However, it can load data to a Lakehouse.
If you initially created a table in your Lakehouse to load data to, how did you create such table? Did you use the Dataflow Gen2 to create it? Assuming that such table needs to change its schema, how do you plan to change its schema? Or are you trying to create a completely new table? If you try to create a new table, how will you create such table?
- DALI0072 years agoHelper II
Hello,
Exactly I used a Dataflow Gen2, a semantic model and a Lakehouse.
To my knowledge, with the default settings, a Direct Lake dataset is automatically refreshed when the data is loaded into a Lakehouse.
Yes, Initially I published manually the dataFlow Gen2 which made me the creation of the table in the lakeHouse.
In a second time I made a transformation on the table at DataFlow Gen2 (Adding a column "type_site" in the table).
my problem how to replace the existing table automatically or manually if the shemas of the table latter changes (in my case : addition of this new column for example) ? Thank you