The Lakehouse does not update when I refresh the Dataflow GEN2

Hi marcosbajr 

Thank you for your reply. Here are some steps you can take to troubleshoot the problem with the data not being sent to the Lakehouse:

1. Check your Dataflow settings to ensure that the Lakehouse destination is configured correctly. Confirm that it is targeting the correct table or you can get errors like in below screenshot.

2. In the Dataflow settings, verify that the automatic refresh schedule is set up properly. Make sure it's configured to run at appropriate intervals and that the correct time zone is applied.

3. Run a SELECT * FROM <table_name> query in your Notebook to see what data is currently in the Lakehouse table. This will help you confirm the number of records and which specific records are stored.

4. If the issue persists after checking the above, consider rebuilding the Dataflow from scratch. This can sometimes resolve hidden configuration issues.

If this post is helpful, please consider marking it as a solution so that other members can find it more easily.

Thank you.