Reduce the size of the data that enters Power BI

[AndreaLee1212]

Hi everyone,

I have a customer using PostGres Sql with Direct Query and have historical data that they don't need, and it's affecting PBI performance.

The customer just want to bring to the PBI the data that on collumn Status is : " Completed".

Are any of the bellow options correct to do this without compromise the performance or from the all options available according to your experience witch one is the best for this situation: 

Option 1 -using dynamically M query parameters to send a query to the DB and exclude "Completed"

Option 2 - to use dataflows and apply a filter to only apply results for status="Completed"

Option 3 - using the Advanced Editor in Power Query Editor and push only results for status="Completed"

Thanks in advance.

[Idrissshatila]

Hello @AndreaLee1212 ,

You could implement incremental refresh https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview

If I answered your question, please mark my post as solution, Appreciate your Kudos 👍

Follow me on Linkedin

[ichavarria · Accepted solution]

Hi @AndreaLee1212,

The recommended option would be: https://learn.microsoft.com/en-us/power-query/connectors/postgresql#connect-using-advanced-options. Which is basically write a native SQL Query that will filter the data for only those with status completed. This will have the best performance as Power BI will only bring what is queried and speed up performance. In Power BI you should always try to avoid bringing data that you do not need. 

Best regards, 

Isaac Chavarria

If this post helps, then please consider Accepting it as the solution and giving Kudos to help the other members find it more quickly