Forum Discussion
Why is loading/refreshing data in powerbi cloud or same problem also in desktop so slow ?
- 8 years ago
What I recommend to you in developing report is to use only tables and columns you need.
Your RAM spending = SUM of memory size of each field together
If you decrease number of columns using SQL then you will decrease it very much.
When you connect to your SQL Server/Azure SQL Database you can mention SQL script as shown below. It can be simple SELECT or something complicated as stored procedure which returns dataset
(In case of Analysis Services it can be written in MDX or DAX)
- 8 years ago
The best solution is this one.
http://community.powerbi.com/t5/Desktop/Combine-multiple-tables-into-one-table/m-p/60752#M24933
Now it works perfectly, everyrefresh/changing parameters in visualization takes 1-2 seconds.... I can consider this link as a solution for everybody who has problem with slow PBI with a lot of tables.
I have maybe 10 bookeepings joined in one table now, 10 tables of invoices joined in one table and so.... one added column in table to indentify company. And all those sources have in querries turn off "enable load" option (so total refresh is working but it is slowing down powerBI).
Anonymous,
You are correct. These settings should be applied to each file separately.
Give me some more details on your reports and systems. I will try to give an alternative.
- Which source type do you use? (SQL Server, Azure SQL, SSAS, Excel etc.)
- Do you use Data Gateway to connect to your source?
- Which connection type you have in the report? (DirectQuery/Import/Live)
- Are you Free or Pro Power BI Service User?
- Do you have Power BI Premium capacity?
- Are you an admin on your PC?
Details:
- mostly sql and some excel
- If I understand it correctly, yes I have on-premises data gateway (personal mode) for daily data update, but I usually refresh it manually. 90% of data sources are sql database, not big, maybe up to 1 ir 5 thouasnds rows.
- I am pro power BI user. [email protected]
- I dont have power Bi premium capacity, I dont know what it is.
- Yes I am admin. But problem is not only in PBI desktop, it is slow also in PBI could = your services/hardware
- ludovit88 years agoHelper I
Hi, this advice doesnt help.
*Go to File -> Options and Settings -> Options -> Query reduction (CURRENT FILE) and select checkboxes
We need use some filters/selections but the main problém is still the very slow refreshing after changing some filters.
I am using PBI desktop, my virtual server has 64GB ram, I have there 4 intel cores and not fully used, maybe just about 30-70%.
But I had to wait sometimes 2-5 minutes, sometimes longer as you can see in first post, in my video. I also show some of my formulas/measures which I used.
Settings in datasource of sql database is import, not DirectQuerry.
So....if I am not talking about BI cloud, but only PBI deskop and my server doesnt seems to be fully used it is maybe some problem with program itself ? Or maybe my calcutions are bad? This your hint, like use apply button, or other options in query reduction doesnt solve the problem. I hope you can maybe help with some other ideas, I like powerbi but it had to be much faster.
Can you give me some other hints for making it faster?
(if you have some additional question just ask me)
my bi virtual server where bi power desktop iswaiting on refresh, after changes in selection (maybe 5 minutes)
- zoloturu8 years agoMemorable Member
As I see on last screenshot you have big amount of tables imported into PBI report.
- Do you use all of tables you've loaded in this particular report?
- Do you use all field of each table?
- What is your level of SQL knowledge?
Very often better to prepare most of all calculated/joined fields on database side. It is not the best when you load all into report. It is better to load 1-2 tables which will have all required information. Good written SQL query can help to optimize speed of loading data from source to report.
- ludovit88 years agoHelper I
1. Yes. It is bookeeping of our comapnies. I need also tab of accounts and also tab of invoices and items of invoices.
So, I have there maybe 10 companies and every have sql database:
- bookeepings (maybe 3-8k rows), two new columns there
- list of accounts (100 rows) connected to excel where we have sorting criteria for that accounts (man. accounting)
- invoices (500 rows)
- items of invoices (2k rows)
Then I have there maybe 2 supporting tables (which use data which are already in pbix, like date, or some sorting/selection) and 2 small excels.
But I am hasitating if can be such an amount of tables really the problem. I can imagine other big companies who can have there much more tables, or not?
2. What do you mean by field? I use mostly several columns but I didnt have time yet make selection/check for dowloading just certain columns. Some table can have 50 columns, another just 10. Do you think that checking for import just that columns which I need can significanlty help ?
3. My sql skills are weak but I have profesional for that. I hope :-).
If it will be possible I will try to make some additional formulas on database side.
One more question.
Can I make from pbix new database (some export or so), can I save it so there are all columns already counted?
Then I can use this new file as a new source just for presentation.