Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply
chris__1
Helper III
Helper III

Power BI Dataflows and ADLS

Hello,

 

for my Power Bi reports I make extensive use of Dataflows. Those Dataflow mostly fall in one of those two categories:

 

Case A: Dataflows that extract and transform data that is being sent to Email Mailboxes. Power Automate is being used to copy those (daily) xlsx/csv reports to different folders (mostly Sharepoint-folders but also folders on our internal servers). Dataflows than combine all the files stored within those folders, transform the data make the result available to the PBI reports.

 

Case B: Dataflows that connect to web sources, (once per day), query data from the website, transform this data and make it available to the PBI reports.

 

For both of those use cases I am wondering if I could use Azure Data Lake Storge Gen2 to improve things! However I do not have any experience with ADLS, so I'm not sure if it will do what I have in mind:

 

Case A: Instead of using Dataflows that currently query (increasingly large!) folders, I wonder if I could set up new dataflows that incrementally add the data from the daily xlsx/csv-reports to the ADLS. The ADLS would than hold all the data from the reports received via mail. This seens better that to query large folders and to combine all the data from all the files every day to refresh the data in the PBI reports.

 

Case B: for those web sources I currently lack any historical data: the dataflow refreshes daily and it gets the current data from the website. But the data it got yesterday is obviously lost. I would like to store this historcal data. The idea would be to set up a dataflow that connects to those sites and saves the data (including a datestamp) to the ADLS. 

 

Never having used ADLS my question is: can I accomplish those goals with ADLS? If so, can you maybe point me to acticles/documentation describing the fundamentals needed to set this up! Is there maybe a solution that is much more suitable to accomplish those goals?

 

Thanks for any help!

 

 

1 ACCEPTED SOLUTION
GilbertQ
Super User
Super User

Hi @chris__1 

 

I think you could do this using Azure Data Factory which would allow you to store the data into ADLS. 

 

This should help get you started: Load data into Azure Data Lake Storage Gen2 - Azure Data Factory | Microsoft Learn





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

View solution in original post

1 REPLY 1
GilbertQ
Super User
Super User

Hi @chris__1 

 

I think you could do this using Azure Data Factory which would allow you to store the data into ADLS. 

 

This should help get you started: Load data into Azure Data Lake Storage Gen2 - Azure Data Factory | Microsoft Learn





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

Helpful resources

Announcements
RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

MayPowerBICarousel

Power BI Monthly Update - May 2024

Check out the May 2024 Power BI update to learn about new features.

LearnSurvey

Fabric certifications survey

Certification feedback opportunity for the community.

Top Solution Authors