Forum Discussion
Error on PBI Service dataset refresh
Fromit87 were you able to resolve the issue? I'm getting the same error.
Hi Anonymous,
Indeed, last Friday we figured that an additional parameter has to be added in the source step. Please have a try, and let me know if it works for you, too.
The issue might be related to Databrick's new Cloud Fetch architecture in runtime 8.3 and above. With a cluster runtime of 7.3 the refresh on service worked smoothly for the same dataset. The issue only occurs, when merging on prem with cloud data in PBI power query and using a on prem Enterprise gateway. As 7.3 has end of support in September the fix below worked for clusters running on 10.4, at least in our environment.
= Databricks.Catalogs("xyz.cloud.databricks.com", "sql/protocolv1/o/0/clusterxyz", [Catalog=null, Database=null, EnableExperimentalFlagsV1_1_0=null, EnableQueryResultDownload="0"])
copy GilbertQ
hi Fromit87 ,
Thanks for your reply. I'm aware of the parameter EnableQueryResultDownload="0".
Microsoft & Databricks suggested to set this parameter in order to get it running. However when you set this parameter you disable Cloud Fetch and you get very slow performance importing data.I noticed that the issue doesn't occur when I go through the public internet (withouth any gateway in place and connecting directly from PBI service to databricks).
Let's hope that Microsoft updates the driver in the next release.
I am having the same issue and adding that parameter works fine desktop however just for ~25k records it takes about 2 mins to refresh the power bi service which is not at all acceptable performance.
I have been following up with MS team and Databricks team on this and have been getting the same answer to add the parameter. Due to security reasons, I cannot connect it without the gateway.
Are you able to confim how slow the performance was in your case?
Worked for me, Thank you
EnableQueryResultDownload="0" fixes the issue for me but strangely this seems to specifically be related to a config issue on my laptop for my UserID. How do I know? I can open PBI on my laptop using a colleagues credentials "run as another user" and have no issues, I can do the same on their laptop with my UserID and no issues, so it's specifically my UserID on my laptop.
I assume this is related to some driver/config issue since I've previously installed Oracle, ODAC, etc., and even though I've uninstalled these I have to believe there's something left behind with a change to Spark ODBC driver or something. If future users of this issue can confirm it's related to your UserID on a specific laptop only maybe we can understand what is misconfigured to avoid needing this code.
