ADLS Gen2 data files hosting

sevenhills · ‎05-23-2022

Hi

To host pre-processed report data files, and consume in Power BI, I am planning as below, please tell whether this is right approach or not ...

ADLS Gen 2

a) Raw data layer: Create blob container, create sub-folders and upload files aka report snapshots files from other systems.

b) Curated data layer: Create one more blob container, copy from Raw data layer and curate them, as these files need some minor modifications

c) Using Power BI dataflow, connect to this curated data layer and build the ETL layer. Then later Power BI datasets from dataflow and then to reports.

Is this right approach of architecture layers/steps? TIA

sevenhills · ‎05-26-2022

@Anonymous , Thanks for the reply.

I am aware and did create ADLS Gen 2 and connecting to Power BI. I am looking more direction of architecture layer/steps, the community is using ...

Is this the right approach?

ADLS Gen 2

a) Raw data layer: (Same storage account, ) Create blob container, create sub-folders and upload files aka report snapshots files from other systems.

b) Curated data layer: (Same storage account, ) Create one more blob container, copy from Raw data layer and curate them, as these files need some minor modifications

c) Power BI dataflow, dataset, reports ... Using Power BI dataflow, connect to this curated data layer and build the ETL layer. Then later Power BI datasets from dataflow and then to reports

(In future, want to explore and add/replace ADLS Gen 2 curated layer with Power BI datamart, which is currently in preview)

Anonymous · ‎05-25-2022

Hi @sevenhills ,

Please have a check.

An Azure subscription. Go to Get Azure free trial.
A storage account that has a hierarchical namespace. Follow the instructions at Create a storage account to create one. This article assumes that you've created a storage account n...
Ensure you're granted one of the following roles for the storage account: Blob Data Reader, Blob Data Contributor, or Blob Data Owner.
A sample data file named Drivers.txt located in your storage account. You can download this sample from Azure Data Lake Git Repository, and then upload that file to your storage account.