Forum Discussion

b5lurker's avatar
b5lurker
Advocate II
7 years ago
Solved

Power BI Dataflow to Azure Data Lake Gen2 Setup

Excited to see all of the new Power BI Dataflow capabilities especially with using Azure Data Lake Gen2 as the storage location for those Dataflows.   But, I have been trying to get it setup using ...
Need Help
  • Michael7's avatar
    Michael7
    7 years ago

    Hi,
     
    There is a temporary issue with settings ACLs through Microsoft Azure Storage Explorer, until this is resolved, as a temporary mitigation you can try using this powershel script:https://setacls.blob.core.windows.net/scriptfolder/setacls.ps1
     
    In order to run the script, your global tenant admin needs to have "Storage Blob Data Contributor (Preview)" role on your storage account.
     
    Instructions on how to run this script:
        
    1. Login as global tenant administrator into Azure portal and open PowerShell (Cloud Shell) in your browser
    2. Choose Azure CLI 2.0 (type ‘az’)
    3. Upload the script (there is a button for it)
    4. Run the script. For example:  /home/admin/setacls -storageaccountname your_alds_gen2_storage_account_name

     

    The script will ask you to sign in, please follow the instructions.
     
    Thanks,
    Michael

     

     

    Hi,

     

    There is no more need in this workaround, please use ASE 1.6.2 which is availably for update and download.

     

    Thanks,

    Michael

bensack's avatar
bensack
Microsoft Employee
7 years ago

Hi Steve, 

 

 

I am sorry for the trouble setting ACLs on the storage account per the documentation. The error you are seeing is a bug in Azure Storage Explorer that unfortunatly prevents setting ACLs for anything but people. It is being fixed, should be available soon, and we are working with the Storage Explorer team on an exact ETA.

 

Until it is fixed, the only option for setting ACLs is via REST API call as documented here:

https://docs.microsoft.com/en-us/rest/api/storageservices/datalakestoragegen2/filesystem/setproperties

but unfortunatly its not trivial, even with the above documentation.

 

 

 

 

We are working to expedite the fix and also find an alternative path until such a fix is available, I hope to have an update soon.

Thank you,

Ben

 

 

 

  • bensack's avatar
    bensack
    Microsoft Employee
    7 years ago

    I would like to update that a new version with the ACL issue fix should be available next week. Until then, another option is to opt in for insider builds of Azure Storage Explorer. In Azure Storage Explorer, click on the Help menu, then Opt in to insider builds. a build should be available via that route sooner.

     

     

    • bensack's avatar
      bensack
      Microsoft Employee
      7 years ago

      Hi All, 

       

      Azure Storage Explorer version 1.6.1 is now available as an insider build, and I can confirm it has fixed the issue of setting ACLs.

       

      Here is what you can do to obtain it:

       

      1.  In Azure Storage Explorer, click on the Help menu, then Opt in to insider builds.

      2.  In Azure Storage Explorer, click on the Help menu, then Check for updates.

      After a few moments, a notification bar will appear notifying you a new version is available with an option to install it.

       

      Once installation is complete, you can follow the instructions in Power BI documentation to complete the setup:

      https://docs.microsoft.com/en-us/power-bi/service-dataflows-connect-azure-data-lake-storage-gen2

       

      Thank you,

      Ben

    • healthEteam's avatar
      healthEteam
      Resolver I
      7 years ago

      Thanks Ben -

       

      If you would, can you please update this thread when this update has been released so we will know when we can go retreive it.

       

      Thanks again

  • joshbrownwsna's avatar
    joshbrownwsna
    Frequent Visitor
    7 years ago
    Hi Everyone,

    Just FYI I ran into the same issue today. However I’ve got one small wrinkle. While I was not able to update the ACLs, I was able to get past the screen in Power BI. Now the service is linked I to my storage account, but does not appear to be writing files to the data lake. FYI.

    Josh
    • bensack's avatar
      bensack
      Microsoft Employee
      7 years ago

      Hi Josh, 

       

       

      The setup of the storage account must happen as documented - the ACLs are critical for the feature to work and the storage account should not be connected to Power BI without them. I recommend you do not try to use the feature until ACLs are set on the filesystem. 

       

      The fix from Azure Storage Explorer should be available next week, but as mentioned above you can opt in for insider builds and get it sooner. 

       

      Please let me know if you have questions or if you run into any trouble after setting the ACLs.

       

      Thanks,

      Ben

       

       

       

      • joshbrownwsna's avatar
        joshbrownwsna
        Frequent Visitor
        7 years ago

        Hi Ben,

         

        Thank you for your reply.  Unfortunately, I linked my power bi account before finding this post. While we have linked the power bi account, we have not configured any of our app workspaces to use the linked storage account. Will using dataflows like this cause us issues or will our flows continue to populate the Power BI storage?

         

        Is there any way in Power BI to unlink the account?  There does not seem to be a setting to do so in the Power BI interface.

         

        Josh