Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

Reply
akhaliq7
Post Prodigy
Post Prodigy

Building a data pipeline/data warehouse in microsoft fabric

I want to use Microsoft Fabric for my data storage.

    1. What is the recommended way to use Microsoft Fabric, should I bring my tables in without doing any transformations and then do the transformations in the warehouse?

 

Also, the original table I would use just as a base table, I would create new tables based on this base table,

    2. Would I create these new tables in the same or a new warehouse?

    3. Would I have these multiple warehouses in one workspace?

 

I have noted that one warehouse is like a data model so I am wary about cluttering up one warehouse with too many tables, views, stored procedures, and functions

1 ACCEPTED SOLUTION
amustafa
Super User
Super User

Assuming you have SQL knowlwdge. Create one Datawarehouse, Load your base tabes as staging tables. Run SQLs to transform your data in Prodcution tables then create Views you need for reporting in Power BI. In my experience you can do data transfomrations in Dataflows and Data Pipelines and still need transofmrations in the DW so why not do it all in one place, easier for audinting purposes.





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




View solution in original post

1 REPLY 1
amustafa
Super User
Super User

Assuming you have SQL knowlwdge. Create one Datawarehouse, Load your base tabes as staging tables. Run SQLs to transform your data in Prodcution tables then create Views you need for reporting in Power BI. In my experience you can do data transfomrations in Dataflows and Data Pipelines and still need transofmrations in the DW so why not do it all in one place, easier for audinting purposes.





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




Helpful resources

Announcements
ArunFabCon

Microsoft Fabric Community Conference 2025

Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.

December 2024

A Year in Review - December 2024

Find out what content was popular in the Fabric community during 2024.