Solved: Fetch data from multiple sources ( SQL and Athena)

Puneet_Jain · ‎05-20-2025

Hi,

I have a requirment where i have to pull some data from SQL and some from athena. I have an option to load the data from both source in POwerBi and then do the transformation BUT thats not feasible as the table size is very big in both enviorments.

So, I am looking for a way where i can join tables from both enviorment and pull only relevant data. Is it possible to do in powerBI ?

Thanks
Puneet

uzuntasgokberk · ‎05-20-2025

Hello @Puneet_Jain ,

If you have Microsoft Fabric capacity, you can take full advantage of Notebooks and Dataflow Gen2 for data transformation. After completing the necessary transformations, you can join your tables and use the Direct Lake mode, which is highly optimized for performance in the Fabric environment.

However, if you only have a Power BI license, you can work with Dataflow Gen1. One recommended approach is to build staging dataflows—these perform initial data extraction and transformations that support query folding. Then, you can create a second dataflow that joins the outputs of these staging dataflows (this is known as a linked dataflow). Please note that linked dataflows require at least a Power BI Premium Per User (PPU) or Premium Capacity license. After you can get data from dataflow gen1 in Power BI desktop and doing data modelling or visualizaions.

For more details on dataflow licensing, please refer to the official documentation:

https://learn.microsoft.com/en-us/power-query/dataflows/what-licenses-do-you-need-in-order-to-use-da...

View solution in original post

v-venuppu · ‎05-26-2025

Hi @Puneet_Jain ,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

View solution in original post

v-venuppu · ‎05-26-2025

Hi @Puneet_Jain ,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

uzuntasgokberk · ‎05-20-2025

Hello @Puneet_Jain ,

If you have Microsoft Fabric capacity, you can take full advantage of Notebooks and Dataflow Gen2 for data transformation. After completing the necessary transformations, you can join your tables and use the Direct Lake mode, which is highly optimized for performance in the Fabric environment.

However, if you only have a Power BI license, you can work with Dataflow Gen1. One recommended approach is to build staging dataflows—these perform initial data extraction and transformations that support query folding. Then, you can create a second dataflow that joins the outputs of these staging dataflows (this is known as a linked dataflow). Please note that linked dataflows require at least a Power BI Premium Per User (PPU) or Premium Capacity license. After you can get data from dataflow gen1 in Power BI desktop and doing data modelling or visualizaions.

For more details on dataflow licensing, please refer to the official documentation:

https://learn.microsoft.com/en-us/power-query/dataflows/what-licenses-do-you-need-in-order-to-use-da...