Forum Discussion

catcollector's avatar
catcollector
Icon for Helper I rankHelper I
5 years ago

Dataflow and Athena - Initial Refresh/Data Load is slow

Hi, we have configured a gateway with a data source to AWS Athena. We are using Dataflow to connect to the AWS Athena dsn and then connecting to Dataflow in Power BI Desktop to build visuals. Initial...
Dataflow
General Comment
Need Help
Tips and Tricks
catcollector's avatar
catcollector
Icon for Helper I rankHelper I
5 years ago

v-janeyg-msft Hi, thank you for your response. We are connecting to the data using Dataflow (in Power BI server). However, you have to load data in the initial creation of the dataflow (refresh now option). We're finding that this "refresh" is taking 30+ minutes to load 302k rows. Unsure if this is common?

v-janeyg-msft's avatar
v-janeyg-msft
Icon for Community Support rankCommunity Support
5 years ago

Hi, catcollector 

 

Does the first refresh take half an hour or is it needed every time,  and can the refresh succeed in the end?It shouldn't be so long,can you share information about refresh history of the dataflow?

If it doesn’t solve your problem, please feel free to ask me.

 

Best Regards

Janey Guo

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

  • catcollector's avatar
    catcollector
    Icon for Helper I rankHelper I
    5 years ago

    v-janeyg-msft It is the first refresh after creating a dataflow that is taking half an hour to load 302k records. This is our first experience with Dataflow, so I don't have a whole lot of experience to go off of. I've read that after the first refresh/initial load, we should consider incremental refresh to prevent from a complete reload each time. This is the approach we plan to take. 

     

    Will you let me know what information you're seeking related to the refresh history? Admittedly, I am not an experience Power BI user, I am the IT partner helping our business partners. If you can explain what you're looking for, I can certainly ask our business partners to provide the necessary information. 

     

    Thank you!