Power BI is turning 10, and we’re marking the occasion with a special community challenge. Use your creativity to tell a story, uncover trends, or highlight something unexpected.
Get startedJoin us for an expert-led overview of the tools and concepts you'll need to become a Certified Power BI Data Analyst and pass exam PL-300. Register now.
Hi,
I am coming across an issue of very slow refreshing and data transformation. Here is my problem:
- I have a large table (about 4 million rows for the last 3 years) which will be appended to the dynamic table (growing each year). I have two options:
1. Exporting the old large data to CSV and keep it in on-premise and then refreshing the power bi by reading that every time.
2. keeping this big file in Power Bi and append it to the new data.
Which way is more efficient?
I appreciate your time
Alireza
Solved! Go to Solution.
For #2, you will need to refresh your data to append it anyway. You could use UNION and a DAX table to avoid the refresh, but I don't recommend that as it will bloat your file size unnecessarily (and it is a bad practice). Do you have the option to use incremental refresh? If so, I would do that. If not, I would store your csv on SharePoint or OneDrive to refresh without need of a gateway.
Regards,
Pat
To learn more about Power BI, follow me on Twitter or subscribe on YouTube.
For #2, you will need to refresh your data to append it anyway. You could use UNION and a DAX table to avoid the refresh, but I don't recommend that as it will bloat your file size unnecessarily (and it is a bad practice). Do you have the option to use incremental refresh? If so, I would do that. If not, I would store your csv on SharePoint or OneDrive to refresh without need of a gateway.
Regards,
Pat
To learn more about Power BI, follow me on Twitter or subscribe on YouTube.
This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.
Check out the June 2025 Power BI update to learn about new features.
User | Count |
---|---|
65 | |
63 | |
52 | |
37 | |
36 |
User | Count |
---|---|
79 | |
67 | |
60 | |
45 | |
45 |