Forum Discussion
Memorable MemberPerformance and memory leak issue - PBIRS Jan 2022
Hello,
After upgrading our production environment to the Power BI Report Server version of January 2022 (1.13.8054.40631), we have significant performance issues.
At real user load (including a slight evening load), we have a significant slowdown in report queries (approximately by 50%), and much higher CPU usage. This happens a few hours after the last restart of services, and worsens over time.
The problem is only on front-end servers (we have scale-out deployment). And the problem is probably somethere in the RSPowerBI.exe process, which higlly utilizes the CPU and also consumes a large amount of RAM (more than the main msmdsrv.exe process). There is nothing unusual in RSPowerBI * .log.
Does anyone else have these problems?
Is there a solution?
I wanted to reply to let you know the May release is now live with a fix for the issue reported on this thread.
51 Replies
PetebroMicrosoft Employee
I wanted to reply to let you know the May release is now live with a fix for the issue reported on this thread.
josef78Hello, I'm also still waiting for a new fixed version. I'm checking out the status and the new ETA, I will let know. Currently I must reset RSPowerBI every 30min which causes other problems. But without restarts PBIRS is not usable.
Terrible.
I work for an international company, and I am responsible for Power BI in two countries with 10,000 employees, and with 3,000 active Power BI RS consumers. And everyone is upset about these problems.I have been solving this problem since the end of February, and I think it is a critical problem (in the case of large deployments). I entered the ticket in March, and the first reaction was that it was a "this is a design issue", with the ticket being archived and not addressed. After the escalation, they confirmed that it is a "bug", but the fix will be in the next version. I'm waiting, we're all waiting more than three months to fix a critical bug!
And this is not the only problem in PBIRS, but it is one critical issue.
I think MS's approach to enterprises is terrible (in the case of Power BI), it's not just about bugs, but also about missing features. While Cloud Power BI has tons of new features every month. On-prem Power BI RS released once every 4 months does not bring any new essential features. The on-prem Power BI RS lacks many key features for enterprises, compared to the Power BI cloud, but also compared to competing solutions.
I know that 1000 individual Power BI cloud users are more important (and more publicly visible) than one company with 10,000 users. But that's no reason to ignore the enterprise segment.
I understand the "Cloud-first" strategy, but currently it's more like "Cloud only, forget on-premises".
Also, Gartner, in their latest Magic quadrant for BI platforms, criticizes Microsoft for "... Microsoft's on-premises offering lacks significant functional capabilities ..."
What do you think about it?
Hello, josef78 !
I'm also a PBI global admin and I'm facing some slow environment performance.
Could you please share with me your Workloads Tenant configuration?
I'm trying to find a way to improve my PBI environment.
Thanks in advance.
- josef78
Hello, yesterday I got information from the support team that "due to some other reasons not released yet, and it will release in a couple of days", but in a few hours the PBIRS May 2022 was releassed...
Change log is not updated yet, I hope this problem is solved. I'm going to install and try it.
Yes, that's right. Specifically about unsupported features. I think it's deliberate approach because some not implemented features are even simpler to make working for on-premise than for cloud.
Guys, how are you? Any update on this problem, the May 2022 version comes out today, I migrated the company's servers yesterday to the January 2022 version and started to have this same problem...
- josef78
Last Update from MS ticket:
I have information from MS Support, this issue is forwarded to the Product Group team, and they have already identified this issue and confirmed it is a bug in this version and they are working on it to fix this in next version.
The PBI product team has fixed this issue and currently working on porting the fix to the May 2022 test build. Depending on how long that takes, it may be too close to the May 2022 release (current ETA is May 24).
I hope that this issue will be definitively resolved in May 2022 release.
Guys, how are you?
Any update on this problem, the May 2022 version comes out today, I migrated the company's servers yesterday to the January 2022 version and started to have this same problem...
Hello Josef, any answer form MS? We have the same problem too. We can make a call (in CZ) if you want 🙂
- josef78
Hello, sorry for delay (lot of work).
Yes, we can make a call, if you want, please send me private message.
SteffeHelper I
Any news on this issue? Seems like there are many organization facing the same issue.
Are Microsoft working on it?
- josef78
Hello, I raised issue ticket too. I have the answer that MS has identified an bug. Now I'm waiting for a bugfix or a new build. I hope for a new build or that it will be resolved in a may release.
It looks like Microsoft doesn't do anything about this issue. Author of this topic posted ticket to Microsoft Support. I'll try to post ticket too if there will be no bug fixes at nearest time.
We are also experiencing high memory usage after upgrading to January 2022, even after the latest update as well. The memory increases during the day until the service crashes and then it repeats. We even changed the settings for ModelCleanupCycleMinutes and ModelExpirationMinutes but it does not solve the problem.
We have a mix of live/import reports and SSRS-reports.
- josef78
Hello,
my current workarround is periodically restart RSPowerBI process (not whole PowerBIReportServer service, because it is time consuming and also need reload all models in to memory).
I'm killing RSPowerBI process every hour (with scheduled powershell script Stop-Process -Name RSPowerBI -Force), PowerBI service immediately start new clean process without any outage.
If there is an active Power BI report data refresh process then with killing RSPowerBI.exe this process will also be killed and stucked in SubscriptionHistory table of PBIRS database. To prevent this I've wrapped this command into the script with checking of existence of active PBI data refresh processes:
$dataSource = "YourSqlServerDBEngineInstanceWherePBIRSDatabaseIsLocated";
$database = "master";
$sql = "
SELECT [SH].[SubscriptionHistoryID]
FROM [PBIRS].[dbo].[SubscriptionHistory] [SH] WITH(NOLOCK)
WHERE [SH].[Status] = 1
";
$auth = "Integrated Security=SSPI;"
$connectionString = "Provider=sqloledb; " + "Data Source=$dataSource; " + "Initial Catalog=$database; " + "$auth; ";
$connection = New-Object System.Data.OleDb.OleDbConnection $connectionString;
$command = New-Object System.Data.OleDb.OleDbCommand $sql, $connection;
$connection.Open();
$adapter = New-Object System.Data.OleDb.OleDbDataAdapter $command;
$dataset = New-Object System.Data.DataSet;
[void] $adapter.Fill($dataSet);
$connection.Close();
$rowsCount=($dataset.Tables | Select-Object -Expand Rows).Count;
if ($rowsCount -eq 0) {
Stop-Process -Name RSPowerBI -Force;
};
I'm also experiencing this problem. The key point of this behavior is leaping high CPU usage. RAM and disk I/O performance are not relevant to this problem (we've tried to increase memory limits of DB Engine and rsconfig and move database to fast nvme disk with no effects). When PBIRS is recently restarted, the problem is not observed. But after some time we can see high CPU usage by rspowerbi.exe process with leaping peaks of CPU usage (up to 100%) and at the same time noticable degradation of portal's and reports response.
