Capacity Derive

Hi BalajiL 

Yes. You have to evaluate capacities when you are dealing with the big data volume. But as I can see they you only have 550 tables meaning how many tables are fact tables vs Dim Tables. If we have 50 tables as a big fact tables (What is Size, No of rows ) , I think so F128 capacity should be fine depending on what approach you are going to take. Also, you only have 320 Spark Notebooks, and Most of the tables are duplicates, so I can say that your data is medium-sized.

We have done the same project around 250 Spark Notebooks, and I was the only developer who was doing end to end approach including CI/CD as well.

For the best advice, you can contact me at my e-mail address ( [email protected] )
For best practices,

1. Use Power BI Dataflow Gen 2 to land data in Fabric SQL Database.

2. Also, Use Kimball Methodology Approach. ( Use Bus matrix, Use Surrogate Key, Use Fact and Use Dimensions ) - Star Schema 

2. Use Microsoft Purview to get a Audit Log etc...