Forum Discussion

TheDataGeek's avatar
TheDataGeek
New Member
4 years ago

Control on output folder structure in Power BI dataflow integration with Azure Data Lake Gen2

I have configured Azure Data Lake Storage to Power BI workspace as described in link below and create dataflows in the workspace.

https://docs.microsoft.com/en-us/power-bi/transform-model/dataflows/dataflows-azure-data-lake-storage-integration

 

 A new container named 'powerbi' is created and a default folder structure of WorkspaceName/DataflowName/CDM files is created, all this is describled in above MS documentation. I need help with controling the folder structure.

 

I have a requirement to dump the CDM files in a specific folder in a different container. I tried moving the CDM files manually and changed the partition links in model.json file and attached the CDM files to power bi dataflow using "Attach a Common Data Model folder (preview)" feature. But the dataflow created cannot be edited or refreshed from power bi service.

 

Is there any way I can dump the dataflow output to a specific location in ADLS without loosing the ability to edit and refresh the dataflow from service?

Dataflow
Need Help

2 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    4 years ago

    Hi TheDataGeek 

    You mentioned that “But the dataflow created cannot be edited or refreshed from power bi service.” , does it mean that it does not take effect without this function, or is there an error ?

    In addition, in the ADLS Gen 2 storage account, all dataflows are stored in the Power BI container of the filesystem. The location where dataflows store data in the folder hierarchy for ADLS Gen 2 is determined by whether the workspace is located in shared capacity or Premium capacity. So where to store it depends on your capacity.

    Best Regards

    Community Support Team _ Ailsa Tao

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

    • TheDataGeek's avatar
      TheDataGeek
      New Member
      4 years ago

      Hello Anonymous ,

       

      Thanks for you reply. Please see my response below

       

      Anonymous wrote:

      Hi TheDataGeek 

      You mentioned that “But the dataflow created cannot be edited or refreshed from power bi service.” , does it mean that it does not take effect without this function, or is there an error ?

      There is no error, the dataflow is created as an external dataflow which cannot be refreshed/edited in power bi service.

      In addition, in the ADLS Gen 2 storage account, all dataflows are stored in the Power BI container of the filesystem. The location where dataflows store data in the folder hierarchy for ADLS Gen 2 is determined by whether the workspace is located in shared capacity or Premium capacity. So where to store it depends on your capacity.

      The folder structure is same for both premium and shared capacity. I am looking for customizing it. Any way to acheive that?

      Best Regards

      Community Support Team _ Ailsa Tao

      If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.