Skip to main content
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Frequent Visitor

Rework on current PBI data setup - tips and tricks needed

Good day beautiful people,


I need your help and some guidance to rework how currently we are working with PBI.


To give you some background, this is how we currently do stuff.


Data flow:

  1. Download data from ATS or related
  2. Upload it to SharePoint
  3. Database is connected to a folder and it is uploading all of extracts to DB (1 extract = 1 table)
  4. PBI is connected to the DB and we download all of these tables (import method).

We cannot change the way how we get data from ATS to DB (via APIs etc.)

Also there is NO SINGLE modification (merge, delete, etc) done on DB level, we download data exactly as they were uploaded.


Tables are not related to each other in any way, they contain some columns which can be found in every extract (e.g., User ID) but in some extracts we have more, in some less.

All the operations (table / column merges, calculations are made in PQ and / or in DAX). Each table contains about 500, 600k rows (biggest 800k, lowest 300k).

You can already imagine that this is SLOW process. Changing anything in PQ, will take about 45 mins from my life.



Currently we have about 12 dashboards and everything is connected via live connection to our main report, so if we would like to change anything, we must change Main_Dashboard to see changes in other visualizations


I'm already on the edge so I decided to do something with it. Right now I'm trying to convince management to this:

  1. Move merges, calculations from PQ to DB (90% of merges are just simple merge to get one column from another table)
  2. Stop using single dataset for multiple dashboards
  3. Add indexes to our DB tables.

But I feel like I'm missing something, and here is where I need your help. What else should I suggest to improve overall experience with PBI? I'm not advanced user so I probably miss some basic steps / solutions.

If not using single dataset, then what? And so on.


I would love to learn more about it but for now I failed to find anything useful in web.


Thank you in advance!

Community Champion
Community Champion

Your plan is the way to go as transformations in the database will perform better than in PQ. To make the remaining PQ development bearable, you could move any ETL not already done in the database out of the dataset and into Power BI dataflows.

1. How to get your question answered quickly - good questions get good answers!
2. Learning how to fish > being spoon-fed without active thinking.
3. Please accept as a solution posts that resolve your questions.
BI Blog: Datamarts | RLS/OLS | Dev Tools | Languages | Aggregations | XMLA/APIs | Field Parameters | Custom Visuals

Helpful resources

Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

Top Solution Authors