topic Re: Is Fabric my best choice? in Data Engineering

Is Fabric my best choice?

IvoBernardo — Wed, 02 Oct 2024 15:07:04 GMT

Hello everyone,

I’m looking for some advice regarding the technologies that I should use to create a data warehouse for my company. The company is small and the data users will be 20/30 users.

Our daily data comes from:

Salesforce (50 GB of stored information);

A random database (less than 4GB);

Excel files.

Reporting:

Excel Files;

Salesforce Reports;

New Power BI Reports.

Needs:

Store information to be available for any type of reporting tool (now PowerBI) and be flexible to do some advanced analytics;

Be able to archive Salesforce information every 5 years;

Allow multiple data sources to be available in one point (that’s why we think data warehouse is a good option).

We’re thinking of using Microsoft Fabric and although I have some experience with Analysis Services and Power BI, I don’t know if this is the correct choice long term. For me, it’s another set of tools to learn, so it’s great and I’m excited, however since I do not have a full Fabric experience, I don’t know if for the size of the company this is a good solution.

Right now, my questions are these:

Is Fabric the best choice? Or should I try to use other Azure systems separately?

If Fabric is the best choice, what should be my main concerns? I’ve seen some concerns online about data security and that Fabric is not ready for production environments.

From the pricing documentation of Fabric, storage is paid besides the Fabric Capacity. Is there any other associated costs that I’m not looking at?

Also, the Fabric Capacity is for what exactly? What operations am I paying by the hour? ETL operations that I do daily/weekly? If I decide to import the information from the data warehouse to the power bi dataset, the hours that I’m using to import the information are considered for Fabric Capacity?

Maybe I’m doing the incorrect questions regarding these subject, but I never built anything like this and I’m very worried about hidden costs. Thanks for reading and for your patience 😊

Re: Is Fabric my best choice?

Anonymous — Fri, 04 Oct 2024 02:40:27 GMT

Hi @IvoBernardo ,

1. Is Fabric the Best Choice?

Fabric can meet your needs, and it integrates with Power BI. It offers a unified platform for data engineering, data warehousing, and data science, which can simplify your workflow.

Here's an official document on how to choose a datastore in Fabric that might be helpful:

Fabric decision guide - choose a data store - Microsoft Fabric | Microsoft Learn

2. Data security

You can learn more about Fabric's data security by reviewing the official documentation:

Security in Microsoft Fabric - Microsoft Fabric | Microsoft Learn

3. Fabric Capacity and Pricing

Fabric Capacity is the set of compute resources allocated to your tenants to support various workloads. For specific information, please see:

Microsoft Fabric: Understanding Capacity - Covenant Technology Partners

To avoid hidden costs, monitor usage closely and set alarms for spikes if you can.

Pricing and answers to frequently asked questions about Fabric can be found here:

Microsoft Fabric - Pricing | Microsoft Azure

If you have any other questions please feel free to contact me.

Best Regards,
Yang
Community Support Team

If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

Re: Is Fabric my best choice?

Anonymous — Thu, 10 Oct 2024 05:58:09 GMT

Hi @IvoBernardo ,

Is my follow-up just to ask if the problem has been solved?

If so, can you accept the correct answer as a solution or share your solution to help other members find it faster?

Thank you very much for your cooperation!

Best Regards,
Yang
Community Support Team

Re: Is Fabric my best choice?

Anonymous — Fri, 25 Oct 2024 07:13:38 GMT

Hi @IvoBernardo ,

Is my follow-up just to ask if the problem has been solved?

If so, can you accept the correct answer as a solution or share your solution to help other members find it faster?

Thank you very much for your cooperation!

Best Regards,
Yang
Community Support Team