Forum Discussion
Helper IDataflow and Athena - Initial Refresh/Data Load is slow
Helper Iv-janeyg-msft Hi, I apologize, I'm a bit confused. The refresh / initial load was successful. However, the concern is that it took 30 minutes to load 302k rows. This seems fairly long considering the fact that we can query this same table in Athena in mere seconds. Is this common? Is it expected behavior?
Community SupportHi, catcollector
You should know that query and loading are not the same.Loading involves the process of connecting to your data source and then loading the entire model data.It is related to the complexity of the data model, so the time may be longer. It is recommended that you directly try to connect to the data source in the desktop, which should shorten a part of the time.
Best Regards
Janey Guo
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
- catcollector
v-janeyg-msft Can you explain what you mean by directly connecting to the data source in Power BI desktop? Do you mean that we should use the ODBC connector in Desktop as opposed to building a dataflow in Service to connect to Athena using an ODBC connector? TIA!
- v-janeyg-msft
Hi, catcollector
Yes,you can directly use ODBC connector to connect to the data source in powerbi desktop,then if you publish your report to PBI service,you need to set up a gataway to refresh.
You can download ODBC Driver here.
Follow the steps in these documents to install and use it in PBI desktop.
Install and Configuration:
How To Connect Microsoft Power BI to Amazon Athena | by Thomas Spicer | Openbridge
Set up refresh for gateway:
Connect Microsoft Power BI to Amazon Athena | by Gaurav Jain | Medium
Best Regards
Janey Guo
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.