- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Dataset refresh timeout
Hi community,
we have our sales data and employee working hours in MySQL tables. I import this data and transform it for Power BI using Power Query. However, this process now takes several hours, which leads to a timeout during the dataset refresh in Power BI online.
What would you suggest? Should I perform the data processing beforehand, e.g., using a PHP script, and make the prepared data available in a new MySQL table for Power BI? What is the best practice here?
Thanks for your help!
Steffen
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @SteffenH82
I would recommend preparing the data as much as possible at the source. Power Query is powerful, but many transformations on big datasets can cause these issues. When connecting to the Database, you can use the Advanced Options to set a timeout
You will be probably aware, but I will mention it anyway. Try and keep the transaction tables as slim as possible, only have ids, dates etc in these tables. If the employee table has Date/Time columns, if you don't need the time, then convert to date only. If you do need the time, create a separate column for the time part. The more cardinality in the columns the faster the load. Move all teh information like products, employee, date, time infomation etc.. to dimension tables. More info here
In the options section of Power BI Desktop, you can set some settings to help with loading times. Turn off Time intelligence if you are using a date table.
Hope these tips help
Joe
Proud to be a Super User! | |
Date tables help! Learn more
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @SteffenH82
I would recommend preparing the data as much as possible at the source. Power Query is powerful, but many transformations on big datasets can cause these issues. When connecting to the Database, you can use the Advanced Options to set a timeout
You will be probably aware, but I will mention it anyway. Try and keep the transaction tables as slim as possible, only have ids, dates etc in these tables. If the employee table has Date/Time columns, if you don't need the time, then convert to date only. If you do need the time, create a separate column for the time part. The more cardinality in the columns the faster the load. Move all teh information like products, employee, date, time infomation etc.. to dimension tables. More info here
In the options section of Power BI Desktop, you can set some settings to help with loading times. Turn off Time intelligence if you are using a date table.
Hope these tips help
Joe
Proud to be a Super User! | |
Date tables help! Learn more
Helpful resources
Join us at the Microsoft Fabric Community Conference
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
Power BI Monthly Update - January 2025
Check out the January 2025 Power BI update to learn about new features in Reporting, Modeling, and Data Connectivity.
Subject | Author | Posted | |
---|---|---|---|
09-06-2024 02:55 AM | |||
12-07-2024 05:24 AM | |||
03-17-2021 07:03 AM | |||
12-10-2023 08:03 PM | |||
05-16-2023 04:43 AM |
User | Count |
---|---|
21 | |
16 | |
11 | |
10 | |
9 |
User | Count |
---|---|
35 | |
28 | |
18 | |
17 | |
13 |