Data Refresh against CRM 2016 Online Slow

I've been working to build some reports against a CRM 2016 online environment.  If I build the queries from scratch I have no issue, however it seems everytime I close the PBIX file and come back, the refresh just doesn't work anymore regardless of the table size.  I'm currently trying to refresh the contact table that has about 9k records in it and it's been running for over 10 mins without success.  Any ideas/suggestions?  I'm new to PowerBI, so this consistent problem is very frustrating.