Storing Data from a Notebook into a Warehouse in Microsoft Fabric

Hi CrhIT ,

I think you can do the steps below:

1. Just as CrhIT said, Microsoft announced the public preview of T-SQL notebooks in Fabric.

2. You can first store your data in a Lakehouse using Python cells in your notebook. Then, use T-SQL cells to create tables in the warehouse from the Lakehouse tables. Here is the document you can read: Data warehouse tutorial - analyze data with a notebook - Microsoft Fabric | Microsoft Learn

3. If direct storage isn't feasible or you prefer a different approach, you can use a Data Factory pipeline to implement incremental data loading:

In the Data Factory section, create a new pipeline and name it appropriately. Add a Copy Data activity from the Move & Transform section.

Use a date field to filter and load only new or updated records. You can set this up in the Source settings of the Copy Data activity by specifying a query that selects data based on the date field.

You can also look at this document: Data warehouse tutorial - ingest data into a Warehouse in Microsoft Fabric - Microsoft Fabric | Microsoft Learn

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.