[Personal Gateway Upgrade required] The On-premises data gateway (personal mode) is now available

[dimazaid]

ACTION REQUIRED BY 7/31/2017 to avoid interruption in your Power BI Data refresh of on-premises data

Hello gateway owners–

Today we're shipped a new, enhanced version of the personal gateway - On-premises data gateway (personal mode). We’re starting the process of moving all existing personal gateways to use the new release. The new release of the gateway is built on top of the same on-premises data gateway infrastructure and will be part of the unified gateway story across the Power * suite (Power BI, PowerApps, and Microsoft Flow). New features in this release include: an improved Fast Combine experience, ability to delete the gateway from the Power BI portal, export logs functionality, and enhanced overall reliability and performance.

More features will be added in the next few months, including the ability to use the gateway in personal mode outside Power BI.

Here’s the link to install the new On-premises data gateway (personal mode).

Moving to the new personal gateway is very simple; you just need to install and configure the On-premises data gateway (personal mode) on your machine. Once it’s configured your datasets will discover the new gateway, and all refreshes will start going through the On-premises data gateway (personal mode) instead of the old personal gateway. Documentation on the new gateway, how to install it, and list of FAQs can be found here.

Refreshes through your existing personal gateway will stop working after July 31st, 2017; please ensure that you upgrade to the new gateway by July 31st, 2017 to keep your datasets up to date. If you have a technical reason preventing you from using the On-premises data gateway (personal mode) or have not been able to migrate to the new personal gateway, please use this post to give feedback or ask questions.

Thanks!
Dimah
Gateway and connectors team

[dtran]

Hi PBI team,

After upgrading to latest personal gateway, I tried to set my authenication (which was 'Windows' in the previous version) but now I am only presented with 'Basic' or 'WindowsWithoutImpresonation'. I choose 'WindowsWithoutImpresonation' as it look like the 'Windows' authentication and was able to sign in.

HOWEVER, I can not able to refresh. Below is the error

I have uninstall/installed a few times but I'm getting the same error. 

Nothing has changed other than upgrading to the new personal gateway.

Please advise.

[CodySigvartson]

Hello,

I have been using live stream data for the past couple weeks and everything has been working fine. As of yesterday (8/9/2017) when I try to upload data to the dataset I get a returned 500 internal server error. However I have not done anything different than I have been doing. What could be causing this sudden error? here is the exception that gets thrown:

Exception while sending to Power BI: System.Net.WebException: Unable to connect to the remote server ---> System.Net.Sockets.SocketException: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond 157.55.171.53:443
at System.Net.Sockets.Socket.DoConnect(EndPoint endPointSnapshot, SocketAddress socketAddress)
at System.Net.ServicePoint.ConnectSocketInternal(Boolean connectFailure, Socket s4, Socket s6, Socket& socket, IPAddress& address, ConnectSocketState state, IAsyncResult asyncResult, Exception& exception)
--- End of inner exception stack trace ---
at System.Net.WebClient.UploadDataInternal(Uri address, String method, Byte[] data, WebRequest& request)
at System.Net.WebClient.UploadString(Uri address, String method, String data)
at System.Net.WebClient.UploadString(String address, String method, String data)
at BatchReportingService.Managers.BatchReportManager.SendToPowerBI(String employeeId, String jobFunction, DateTime timestamp, Int32 monitorCount, Int32 monitorCountGoal, String monitorType) in C:\Users\sigvarco\Documents\Visual Studio 2017\Projects\BatchReportingService\BatchReportingService\Managers\BatchReportManager.cs:line 221

[Iguberkov]

The approach provided by @dsynan worked for me & there was no negative effect on the refresh duration. Maybe my datasets are smaller & thus I cannot feel this slow-down.

In any case thanks for the help.

[jickes]

Changing to HTTPS worked, but the refresh now takes considerably longer for my large datasets. This is not a fix, but just a workaround for now. 

I had to change to use the non-personal gateway. The personal mode gateway converted all of my connection strings to lowercase for some reason, so it was unable to refresh because of the case not matching drivers on my machine that it was looking for. This is a rediculous issue to have on a production solution....

[dsynan]

@dimazaid I have a ticket submitted with the MS support team and they are researching my issue. I cannot get the personal on-prem gateway to install fully and it times out when it's trying to authenticate me as a user. My old Personal Gateway has already been uninstalled. Is there a link or download for the old version that I can use until 7/31? I'm hopeful I will be able to resolve my issue through the MS support team or my own IT helpdesk by then. 

[jickes]

I'm unable to get the new gateway to work.

I uninstalled the old gateway, but am receiving the below error when installing the new. I looked, and the pbiegwservice doesn't exist in my services. So i'm thinking it didn't get created properly? I've tried installing 5 times now, with uninstalling, removing folders, and restarting and still no luck. 

Failed to update gateway details. Please try again.
This request operation sent to net.pipe://localhost/powerbi/personalgatewayconfiguration/service did not receive a reply within the configured timeout (00:01:00). The time allotted to this operation may have been a portion of a longer timeout. This may be because the service is still processing the operation or because the service was unable to send a reply message. Please consider increasing the operation timeout (by casting the channel/proxy to IContextChannel and setting the OperationTimeout property) and ensure that the service is able to connect to the client.

Server stack trace:
at System.ServiceModel.Dispatcher.DuplexChannelBinder.Request(Message message, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.PowerBI.DataMovement.Pipeline.InternalContracts.IGatewayConfigurationService.UpdateGatewayConfiguration(UpdateGatewayConfigurationRequest request)
at Microsoft.PowerBI.DataMovement.Pipeline.GatewayClient.GatewayConfigurationClient.UpdateGatewayConfiguration(UpdateGatewayConfigurationRequest request)

[Iguberkov]

I have exactly the same problem as @jickes. Got the notification to upgrade, thing didn;t go well. Uninstalled the old personal gateway, tried to install the new one and received the same error. Already tried several installs/uninstalls, restarts. Everything else was working correctly before, so your help on this one would be appreciated.

[dsynan]

This worked for me and was provided by the MS support team...

%localappdata%\Microsoft\On-premises data gateway (personal mode)\Microsoft.PowerBI.DataMovement.Pipeline.GatewayCore.dll.config change the value to Https

      <setting name="ServiceBusSystemConnectivityModeString" serializeAs="String">

        <value>Https</value>

      </setting>

Then kill the Microsoft.PowerBI.DataMovement.PersonalGateway.exe process from task manager and restart configuration.

[psheridan]

I upgraded to the On-Premises Data Gateway (Personal) now having issues with one of my connections (OLEDB). Tried all authentication options - basic, anonymous and windowswithoutimpersonation...no luck with any of these. Is there a known issue related to OLEDB connections? Please advise what I need to do to get my datasets rescheduled/refreshed.

Thanks

[DavidL]

Live/Direct Query of OLEDB sources is not supported - could that be the issue?

https://powerbi.microsoft.com/en-us/documentation/powerbi-gateway-onprem-indepth/

[psheridan]

Yes, I think thats the issue (at least w/Personal Mode). I tried installing regular on-prem gateway as well and was able to input datasource information but whenever I clicked "add" nothing happened. Guess now I am stuck manually refreshing and publishing and hopefully a solution for OLEDB is implemented.

[klyhne]

Hi,

We are not able to refresh our dataset via the Power BI Service. We have no issues refreshing in Power BI Desktop.

We are using the On-Premises Data Gateway (Personal mode) in the newest version.

Below is the error information in the Power BI Service:

Last refresh failed: Mon Jul 10 2017 08:15:08 GMT+0200 (Rom, sommertid) 
We reached the data gateway, but the gateway can't access the on-premises data source.
Cluster URI:	WABI-EUROPE-NORTH-B-redirect.analysis.windows.net
Activity ID:	6fca8717-2ff8-44ad-b392-c0d011051cfe
Request ID:	e4ab4f72-9440-3d69-c6ae-88aa6f09adf8
Time:	2017-07-10 06:15:08Z

Any help is very much appreciated.

Regards,

Kristian

[klyhne]

Hi,

I am not able to refresh my data via the Power BI Service. I have no issues refreshing data with Power BI Desktop.

We are using the On-Premises Data Gateway (Personal Mode) in the newest version.

The error I get when trying to refresh is:

Last refresh failed: Mon Jul 10 2017 08:15:08 GMT+0200 (Rom, sommertid) 
We reached the data gateway, but the gateway can't access the on-premises data source.
Cluster URI:	WABI-EUROPE-NORTH-B-redirect.analysis.windows.net
Activity ID:	6fca8717-2ff8-44ad-b392-c0d011051cfe
Request ID:	e4ab4f72-9440-3d69-c6ae-88aa6f09adf8
Time:	2017-07-10 06:15:08Z

There is no further information about the error.

Any help is very much appreciated.

Regards,

Kristian

[pquezada]

hey hi!

i have the same problem!

i can connect with the SSAS. Power Bi see the cube, but not connet, and show me this error.

¿solution?

 

and the log gateway:

[starmoonknight]

Hi Dimah,

I reinstalled my OS due to a faulty drive thus has directly downloaded the new On-premises data gate way (personal mode). (I used to be a personal gate way user)

After I signed in the gateway, it asked me to update my credentials for datasets the PBI. However, all credentials could be updated but the analysis cube.

I also have some OneDrive files as data sources whose authentication method is also "WindowsWithoutImpersonation" and they worked well. 

BTW, I use "my current credential" for the same analysis cube in PBI desktop and it works good. I tried to publish the pbix file again to replace the existing dataset but still got the same error. Not sure what's the issue here. Could that be a local computer configuration issue?

Very much appreciated if you give me sime advise.

Many thanks in advance,

Olivia 

[dimazaid]

Hi @starmoonknight,

Can you check the gateway logs and see what additional info it's providing? 

You can find this by going re-opening the gateway from your machine (Start->"On-premises data gateway (personal mode)"), sign in, and click on export logs. 

Thanks!
Dimah 

[starmoonknight]

Hi @dimazaid

Since the log is quite long, I searched for possible key words, and the following is quoted from the log which might be helpful:

......

DM.PersonalGateway Error: 0 : 2017-06-18T23:40:57.3111621Z DM.PersonalGateway 00000000-0000-0000-0000-000000000000 00000000-0000-0000-0000-000000000000 0000 00000000-0000-0000-0000-000000000000 435C38AF [DM.Analytics] Performance counters not installed, application performance metrics will not be traced (category = On-premises data gateway)
DM.PersonalGateway Information: 0 : 2017-06-18T23:40:57.6551754Z DM.PersonalGateway 00000000-0000-0000-0000-000000000000 00000000-0000-0000-0000-000000000000 0000 00000000-0000-0000-0000-000000000000 CAB8F9C3 [DM.GatewayCore] Attempting to create and start service host for 'Transfer service'
DM.PersonalGateway Information: 0 : 2017-06-18T23:40:57.7706991Z DM.PersonalGateway 00000000-0000-0000-0000-000000000000 00000000-0000-0000-0000-000000000000 0000 00000000-0000-0000-0000-000000000000 F3B572FA [DM.GatewayCore] Using configured 'AutoDetect' for ServiceBus ConnectivityMode
DM.PersonalGateway Information: 0 : 2017-06-18T23:40:57.8459589Z DM.PersonalGateway 00000000-0000-0000-0000-000000000000 00000000-0000-0000-0000-000000000000 0000 00000000-0000-0000-0000-000000000000 87990171 [DM.GatewayCore] Creating GatewayTransferServiceHost against 'sb://wabi-south-east-asia-relay36.servicebus.windows.net/eedcdc10-bdc2-459d-b8d0-227ce63e01fa/' with following binding configuration: {"ReliableSession":{"Enabled":false,"Ordered":true,"InactivityTimeout":"00:10:00"},"HostNameComparisonMode":0,"ConnectionMode":0,"TransferMode":0,"MaxBufferPoolSize":8500000,"MaxBufferSize":8500000,"MaxConnections":1500,"ListenBacklog":10,"IsDynamic":false,"MaxReceivedMessageSize":8500000,"ReaderQuotas":{"MaxStringContentLength":8192,"MaxArrayLength":16384,"MaxBytesPerRead":4096,"MaxDepth":32,"MaxNameTableCharCount":16384,"ModifiedQuotas":0},"Scheme":"sb","EnvelopeVersion":{"NextDestinationActorValue":"http://www.w3.org/2003/05/soap-envelope/role/next"},"Security":{"Mode":1,"RelayClientAuthenticationT..."}
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:00.2643817Z DM.PersonalGateway 00000000-0000-0000-0000-000000000000 00000000-0000-0000-0000-000000000000 0000 00000000-0000-0000-0000-000000000000 0756374B [DM.GatewayCore] ServiceEndpoint Connection status: Online, LastError: ''
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:00.2847940Z DM.PersonalGateway 00000000-0000-0000-0000-000000000000 00000000-0000-0000-0000-000000000000 0000 00000000-0000-0000-0000-000000000000 500124B1 [DM.GatewayCore] Transfer service started
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:00.2847940Z DM.PersonalGateway 00000000-0000-0000-0000-000000000000 00000000-0000-0000-0000-000000000000 0000 00000000-0000-0000-0000-000000000000 0CF4AAA9 [DM.GatewayCore] <ii>sb://wabi-south-east-asia-relay36.servicebus.windows.net/eedcdc10-bdc2-459d-b8d0-227ce63e01fa/</ii>
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:00.3337406Z DM.PersonalGateway 00000000-0000-0000-0000-000000000000 00000000-0000-0000-0000-000000000000 0000 00000000-0000-0000-0000-000000000000 0E6D6CC9 [DM.GatewayCore] Successfully created and started service host for 'Transfer service'
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:18.4266036Z DM.PersonalGateway 693b20b4-325a-4007-8963-c65274a87b61 ed2d4621-ebf9-4e4e-b419-3b2ec8bb66d3 MGPP 00000000-0000-0000-0000-000000000000 A08BF3B6 [DM.GatewayCore] Deserialized TestGatewayConnectionRequest, executing
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:32.2617806Z DM.PersonalGateway 0c832e9b-cc4b-480f-a9da-4b4dcaeca4c8 439b3242-beb8-4d75-9762-e1dca2a08f6b MGPP 88233a60-e569-43d4-a615-62ee291b9a1e E5E3865A [DM.GatewayCore] Deserialized OpenConnectionRequest, executing
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:32.3137012Z DM.PersonalGateway cbea8389-4947-413f-803b-0b29410b6670 439b3242-beb8-4d75-9762-e1dca2a08f6b MGPP 88233a60-e569-43d4-a615-62ee291b9a1e E5E3865A [DM.GatewayCore] Deserialized OpenConnectionRequest, executing
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:32.3327019Z DM.PersonalGateway c6ab6a7d-f813-4e5b-a738-931fbd264ab3 439b3242-beb8-4d75-9762-e1dca2a08f6b MGPP 88233a60-e569-43d4-a615-62ee291b9a1e E5E3865A [DM.GatewayCore] Deserialized OpenConnectionRequest, executing
DM.PersonalGateway Warning: 0 : 2017-06-18T23:41:32.5319431Z DM.PersonalGateway 6acb356a-0dde-4241-b3f4-45337aa91553 439b3242-beb8-4d75-9762-e1dca2a08f6b MGGC 88233a60-e569-43d4-a615-62ee291b9a1e 9315B129 [DM.Pipeline.Common] Failed to parse gateway core config file: Object reference not set to an instance of an object.
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:32.5549177Z DM.PersonalGateway 2b48e621-2c8d-437d-9032-d08ec789a7ec 439b3242-beb8-4d75-9762-e1dca2a08f6b MGCC 88233a60-e569-43d4-a615-62ee291b9a1e 23BF7B0C [DM.GatewayCore] Db pool opening raw database connection to [Microsoft.Mashup.OleDb.1: <pi>Microsoft.Mashup.OleDb.1:TRUNCATED:[Basic] Encrypted Credential information omitted</pi>]
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:32.5549177Z DM.PersonalGateway 8a0b78d0-aed7-4feb-b4e7-28e1d2e66ea2 439b3242-beb8-4d75-9762-e1dca2a08f6b MGCC 88233a60-e569-43d4-a615-62ee291b9a1e 23BF7B0C [DM.GatewayCore] Db pool opening raw database connection to [Microsoft.Mashup.OleDb.1: <pi>Microsoft.Mashup.OleDb.1:TRUNCATED:[Basic] Encrypted Credential information omitted</pi>]
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:32.5629089Z DM.PersonalGateway 8fd162d9-d753-4096-9def-aba9936a0a81 439b3242-beb8-4d75-9762-e1dca2a08f6b MGCC 88233a60-e569-43d4-a615-62ee291b9a1e 1522A50B [DM.GatewayCore] Db pool opening raw database connection to [Microsoft.Mashup.OleDb.1: <pi>Microsoft.Mashup.OleDb.1:TRUNCATED:[WindowsWithoutImpersonation] Encrypted Credential information omitted</pi>]
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:32.6867711Z DM.PersonalGateway 6d304a1a-fb7a-4022-8c68-bad36b698ea5 439b3242-beb8-4d75-9762-e1dca2a08f6b MGCC 88233a60-e569-43d4-a615-62ee291b9a1e 1522A50B [DM.GatewayCore] Db pool opening raw database connection to [Microsoft.Mashup.OleDb.1: <pi>Microsoft.Mashup.OleDb.1:TRUNCATED:[WindowsWithoutImpersonation] Encrypted Credential information omitted</pi>]
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:32.6867711Z DM.PersonalGateway 5f7550f7-5e68-4bf4-bf2e-1aed84444d82 439b3242-beb8-4d75-9762-e1dca2a08f6b MGCC 88233a60-e569-43d4-a615-62ee291b9a1e 1522A50B [DM.GatewayCore] Db pool opening raw database connection to [Microsoft.Mashup.OleDb.1: <pi>Microsoft.Mashup.OleDb.1:TRUNCATED:[WindowsWithoutImpersonation] Encrypted Credential information omitted</pi>]
DM.PersonalGateway Information: 0 : 2017-06-18T23:41:32.6867711Z DM.PersonalGateway ed1ec124-0e0d-41c3-b1f3-aa1bcfdec43d 439b3242-beb8-4d75-9762-e1dca2a08f6b MGCC 88233a60-e569-43d4-a615-62ee291b9a1e 1522A50B [DM.GatewayCore] Db pool opening raw database connection to [Microsoft.Mashup.OleDb.1: <pi>Microsoft.Mashup.OleDb.1:TRUNCATED:[WindowsWithoutImpersonation] Encrypted Credential information omitted</pi>]

......

Thanks,

Olivia

[fenil]

Raksha Bandhan, or simply Rakhi is a Hindu religious and secular festival.A collection of sweet messages you can send to your brother/sister on the auspicious occassion of Raksha Bandhan.
Please visit   Rakshabandhan Quotes

India is known worldwide for its rich heritage and cultural beliefs. For the richness and sweetness attained, the country pays tribute to various people who played an influential role in this attainment. There are many special days celebrated all over the nation to memorize these special people and their significant contributions..
Please visit  Independence Day Quotes

[dimazaid]

Thanks for sharing. I've shared this with our team to take a look.

[nickgraves]

Dimazaid, What was the feed back from the team as we have exactly the same issue.

THanks

Nick