Forum Discussion

marcvd's avatar
marcvd
Frequent Visitor
3 years ago

Training import (Belgium)

Hi all

I would really like (and need) a training regarding import of SQL database in PBI.

I'm not a rookie, but absolutely not an expert.

Main frustration:

- import 34 tables

- one table with over 8 milion lines

- refresh -> 13 min!!

 

Can someone help me out, or point me to the right training / book / youtube video..

Thank you! Have a nice weekend

M

2 Replies

  • Hi,

     

    To optimize the performance of the import process, you can take the following steps:

    1. Remove unnecessary columns: Only import the columns that you actually need to use in your Power BI reports.

    2. Use DirectQuery or Live Connection: Instead of importing the data into Power BI, you can use DirectQuery or a Live Connection to connect to the SQL database. This way, the data will stay in the SQL database and Power BI will only retrieve the data that is needed for the visualizations.

    3. Use Power BI's data compression: Power BI has a built-in data compression feature that can reduce the size of the data stored in Power BI, thus improving the refresh performance.

    4. Use Power BI's row-level security: This feature allows you to restrict access to the data based on a user's role. By limiting the amount of data that each user can see, you can reduce the amount of data that needs to be refreshed.

    5. Use DAX measures: Instead of using complex calculations in the SQL database, consider using DAX measures in Power BI. DAX measures can be highly optimized for performance and can reduce the amount of data that needs to be imported.

    6. Partition the large table: Consider partitioning the large table with over 8 million lines into smaller tables. This way, you can refresh each partition separately and reduce the time it takes to refresh the entire table.

    7. Use Power BI's indexing feature: Power BI has a built-in indexing feature that allows you to optimize the performance of your queries. By indexing the columns that are frequently used in your reports, you can improve the performance of your queries.

    8. Consider using Power BI Premium: Power BI Premium is a paid version of Power BI that provides better performance and scalability. If you have large amounts of data and need fast refresh times, Power BI Premium might be the solution you are looking for.

    I hope these tips help you optimize the performance of your SQL database import in Power BI.