topic Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died in Report Server

Issue: Power BI RS May 2023 release - Child Process [Portal] Died

josef78 — Mon, 19 Jun 2023 18:30:36 GMT

Hello all,

After upgrade to Power BI RS May 2023 (15.0.1112.48) on production enviroment and load, I have numerous issues with RSPortal.exe process.

Power BI portal sometimes drops some requests and is unavailable for a while in the day, and it gets worse over time (until I restart the entire service).

In RSHostingService log I found many (every few minutes under load) warning like this:

Child Process [Portal] Died. Check the log for further information

Sometimes followed with message:

Immediate restart of process Portal

Or after some delay (when service is unavaliable) followed with message like:

Throttled restart of process by 670 761,67ms: Portal

In RSPortal log I not found nothing interesting, except sometimes repeating message:

Received a request with an unmatched or no authentication scheme.

I not found any of these messages in log before May 2023 version. I think this can be a critical problem on large environments.

Please anyone, do you have any similar problems?

Thanks for the help.

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

d_gosbell — Mon, 19 Jun 2023 23:53:15 GMT

josef78 - I have not seen any other reports of an issue like this on the forum. It is probably best to raise a support ticket, it sounds like it might be a load related issue and if the logs do not hold any clues it might need a more focussed investigation

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

YusufCakar — Tue, 20 Jun 2023 14:36:43 GMT

Hello everyone,

I am getting the same error in Power BI Report Server may 2023 update.

Can you support?

Enjoy your work.

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

d_gosbell — Wed, 21 Jun 2023 01:22:34 GMT

YusufCakar wrote:

Hello everyone,

I am getting the same error in Power BI Report Server may 2023 update.

Can you support?

Enjoy your work.

As mentioned above. I think an official support ticket is the best approach here. This is not expected behaviour.

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

YusufCakar — Wed, 21 Jun 2023 08:41:55 GMT

Hello,

Clean install on new server. But the problem was not solved.

No user access this error keeps repeating.

It's like a vicious circle.

Service Unavailable when not restarted
We are getting HTTP Error 503. The service is unavailable.

logs:

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

josef78 — Thu, 22 Jun 2023 13:49:42 GMT

Hello,

Thank you, yes, I will rise the ticket. So far, I've tried to investigate this issue to see if it's an infrastructure issue, or a specific workload, or an application error.

I think it's an app bug. It has affected both of my environments, but is dependent on the load and how long the service has been running (since the last reboot).
On lightly loaded environments (my test) this is not a critical problem (several connection failures per week). On very busy enviroments, this is a critical problem (random connection failures and restarts of this process at any time, and massive outages of availability after several hours of heavy traffic).

Also I'm trying find any workaround, but currently only option is hard restart of PBIRS services some times per day.

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

josef78 — Thu, 22 Jun 2023 14:04:11 GMT

Hello

The official ticket is the right way to go.

But any more information about this problem or workaround and other cases where this problem occurs can help or increase the priority.

I don't know of any solution at this time, other than rolling back (almost impossible) or restarting PBIRS periodically.

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

v-alipat — Fri, 23 Jun 2023 09:04:28 GMT

Hi all!

josef78 , YusufCakar

Thank you for reporting the problem.

We are looking into it now, and here is a possible workaround for your situation:

Navigate to RSPortal.exe.config file (Typically located at "C:\Program Files\Microsoft Power BI Report Server\PBIRS\Portal")

Find there an element <system.diagnostics>, and remove it
(Remove this piece: )

<system.diagnostics>

</listeners>

</source>

</sources>

</sharedListeners>

</switches>

</system.diagnostics>

Could you please try this out, and let us know if this actually helps?

Looking forward to hear back from you, while we continue our investigation.

Thanks,

Alexandra

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

josef78 — Thu, 22 Jun 2023 15:58:27 GMT

Thank you for your help and quick response.

I used this workaround. At first look, it is maybe better. But in this place, it's evening out of office hours, and I'm not able to check it at the real production load now.
I'll check more tomorrow and come back.

Thanks,

Josef

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

mpsrshl — Thu, 22 Jun 2023 20:47:15 GMT

Hey, just out of curiosity, how big is your instance of PBIRS? I'm about to run the server upgrade for this weekend.

We have a dual core 4 logical cpu, 64 RAM.

Never had speed or clogging issues. I hope it goes smooth we need this upgrade to do embedding reports

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

josef78 — Fri, 23 Jun 2023 06:40:48 GMT

Hi,

in total (multi server scale-out PBIRS) we have 16 physical core hi-perf xeon and 1TB RAM. And currently planning upgrade to twice as much.

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

YusufCakar — Fri, 23 Jun 2023 08:48:20 GMT

Hello,
Thank you for your quick response.
But downgrade was the only salvation for us. Everything is okay right now. I think there is a problem in May 2023.
I hope the problem will be fixed soon.
Kind regards.

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

v-alipat — Fri, 23 Jun 2023 09:02:22 GMT

Hello again,

Sure, work is in progress, we will find the root cause and fix it.

That new config part is our "primary suspect" at the moment, that's why we are looking for a confirmation that disabling it solves the problem for you too 🙂

Do I get it right that you didn't have a chance to try the workaround before downgrading?

This info would be very helpful for us.

Thanks,

Alexandra

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

YusufCakar — Fri, 23 Jun 2023 10:57:34 GMT

Hello again,

-Do I get it right that you didn't have a chance to try the workaround before downgrading?

-Yes. You got it right. Sorry for not being able to test it. 😢

Kind regards.

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

josef78 — Fri, 23 Jun 2023 10:59:18 GMT

Hello,

After half a day of Friday's load, this workaround seems to work great. There are no outages related to the RSProtal process dying.

I will continue to monitor and check again on Monday evening after a full standard day (Friday is usually less utilised).

Thank you so much.

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

josef78 — Mon, 26 Jun 2023 20:14:05 GMT

Hello v-alipat ,

I can confirm, that this workaround is working great. There no mentioned errors and no outages.

Please what are next steps? New fixed version will be released?

Thank you much,

Josef

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

v-alipat — Thu, 29 Jun 2023 11:46:03 GMT

Hello all!

The fix for this problem will be included in the next release of PBIRS.

It is still not determined if there will be a QFE to May release, or if it will be a part of September release.

Thanks,

Alexandra

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

Gorblimey — Fri, 30 Jun 2023 07:18:44 GMT

This workaround seems to work for us too! Thank you very much indeed.

Before applying the workaround the issue was reproducible by updating Reports that use the Power Query "sharepoint.table" command to read from SharePoint 2019 libraries (on-premise).

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

v-alipat — Thu, 17 Aug 2023 10:46:17 GMT

Hi all!

Letting you know that the fix for this issue was released and the new version can be downloaded here:

Microsoft Power BI Report Server - May 2023

The problem should not happen in the new version, if you still experience the sympthom after upgrade, please let us know.

Thanks,

Alexandra

Re: Issue: Power BI RS May 2023 release - Child Process [Portal] Died

NTex — Mon, 04 Sep 2023 18:14:53 GMT

Hi Alexandra

Actually we recently upgraded our test environments with this version 15.0.1112.79 and we start having issues.

Uploading a singe file (~100MB) that usually would take 20 secs, increased to 8 mins alone (this is using Reporting Services Powershell Module, it's an automation we use to integrate our Pipelines from AzureDevOps).

Also, uploading the file manually through the browser acts normal = 20 secs.

Then we found this thread and removing that piece with systems diagnostics, solved it.

So I think the bug might not be squashed yet ?

Thanks