Forum Discussion
Data not getting reflecting into lakehouse/warehouse when pipeline got completed successfully.
Advocate IVHi ESharathChandra , This could be because of the SQL Endpoint delays (known issue).
If you manually refresh the metadata sync, does it reflect the new data?
If yes, you could try triggering the SQL endpoint programatically as mentioned Refresh SQL analytics endpoint Metadata REST API (Preview) | Microsoft Fabric Blog | Microsoft Fabric
One way is to invoke this script given https://github.com/microsoft/fabric-toolbox/blob/main/samples/notebook-refresh-tables-in-sql-endpoint/MDSyncNewRESTAPI.ipynb as a notebook activity after your load job is finished.
Thanks for the response Gpop13 , No the new data didn't even enter into lakehouse and the lakehouse table was empty today.
Metadata sync issue is known one. I encountered it multiple times when I get data from OnPrem Sql server to lakehouse using Copy data activity and then load into warehouse table. In this case the data gets into lakehouse but due to sync issue new data doesn't get into warehouse.
But Today in my case the copy data activity which gets data from OnPrem to lakehouse ran and json output when checked had rows copied as well. But after completion of pipeline the lakehouse table itself is empty.