topic Advice re: data warehouse in Developer

Advice re: data warehouse

mpothen — Tue, 12 Dec 2023 16:04:21 GMT

Hi all,

I'm new to Fabric, etc. I'm wanting to create a data warehouse with data from two seperate accouting systems (so the analysts can do inter-company analysis). One DB is pn prem SQL server. The other one is Business Central.

The approach I'm thining about is using Fabric to create a DW with Pipelines to each system, but I'm not sure if this is the best approach (for the data volume, cost, whatever). I don't want to go down a path I'd regret later.

How would you approach this?

Re: Advice re: data warehouse

mpothen — Tue, 12 Dec 2023 16:05:54 GMT

Also... Pipeline vs Dataflow Gen2? I noticed the dataflow only lets me pull over 50 tabels (queries) at a time.. so I would have to creat many of these.. unless I'm doing it wrong. I'm assuming a Pipeline would let me pull them all over more easily??

Re: Advice re: data warehouse

Anonymous — Mon, 18 Dec 2023 02:20:05 GMT

Hi @mpothen,

For fabric data warehouse usages, you can refer to the official tutorial document:

Data warehouse tutorial - introduction - Microsoft Fabric | Microsoft Learn

BTW, fabric included multiple products and it did not prevent you to use multiple fabric features at the same time.

Regards,

Xiaoxin Sheng