Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
sabrinasimao
Frequent Visitor

Local data storage using ODBC with AWS Athena

Hi,

 

I was wondering how Power BI stores the data queried from Athena.

I have a direct connection between my report, the ODBC middle driver and the Athena data catalog.

I run a query in Power BI to get the data from it's source, and I have several datetime filters and select statements.

Will the data stored on my report and local machine be only the ones queried, or will Power BI import the whole database from Athena to run the query locally?

 

I can provide further information if necessary or if the question is not clear

 

Thank you!

1 ACCEPTED SOLUTION
v-xiaoyan-msft
Community Support
Community Support

Hi@sabrinasimao,

 

Athena also has 30.000 rows limit .

The CData Amazon Athena Connector contains an embedded SQL Engine that pushes supported SQL operations to the data source and processes unsupported operations client-side (Query Folding).

 

Please check if the following is useful :https://www.cdata.com/drivers/athena/powerbi/?gclid=EAIaIQobChMIsN7R_vCx7wIVQteWCh3GGQv-EAMYASAAEgI3... 

 

https://blog.openbridge.com/how-to-connect-microsoft-power-bi-to-amazon-athena-c2cc4f295ac4 

 

 

Hope it helps.

 

Best Regards,
Caitlyn Yan

 

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

 

 

 

View solution in original post

3 REPLIES 3
v-xiaoyan-msft
Community Support
Community Support

Hi@sabrinasimao,

 

Athena also has 30.000 rows limit .

The CData Amazon Athena Connector contains an embedded SQL Engine that pushes supported SQL operations to the data source and processes unsupported operations client-side (Query Folding).

 

Please check if the following is useful :https://www.cdata.com/drivers/athena/powerbi/?gclid=EAIaIQobChMIsN7R_vCx7wIVQteWCh3GGQv-EAMYASAAEgI3... 

 

https://blog.openbridge.com/how-to-connect-microsoft-power-bi-to-amazon-athena-c2cc4f295ac4 

 

 

Hope it helps.

 

Best Regards,
Caitlyn Yan

 

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

 

 

 

amitchandak
Super User
Super User

@sabrinasimao , In case the connection is direct query, Power query the database. In case of import mode it stores the data

refer these to understand those

https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-use-directquery

https://radacad.com/directquery-live-connection-or-import-data-tough-decision

Not quite what I was saying. I still want to import some parts of my table locally. I was just wondering if the Athena has 30.000 rows and I use ODBC to run a query that filters by Date and only returns 2.000 rows, will only the 2.000 rows be stored in the report, or will ODBC import the whole database to run that query locally.

 

It's a performance issue kinda

 

Thank you!!

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.