Forum Discussion

bcdobbs's avatar
bcdobbs
Community Champion
4 years ago
Solved

Dataflows - Bring Your Own Storage

Hi,

 

I'm experimenting with Configuring dataflow storage to use Azure Data Lake Gen 2 - Power BI | Microsoft Docs.

 

In terms of just using a Gen2 data lake for dataflows is there a noticble performance difference between using the Standard and Premium performance tiers?

 

 

  • Anonymous's avatar
    Anonymous
    4 years ago

    Hi bcdobbs ,

    If your workloads require a low consistent latency and/or require a high number of input output operations per second (IOP), consider using a premium block blob storage account. This type of account makes data available via high-performance hardware. Data is stored on solid-state drives (SSDs) which are optimized for low latency. SSDs provide higher throughput compared to traditional hard drives. The storage costs of premium performance are higher, but transaction costs are lower, so if your workloads execute a large number of transactions, a premium performance block blob account can be economical.

    If your storage account is going to be used for analytics, we highly recommend that you use Azure Data Lake Storage Gen2 along with a premium block blob storage account. This combination of using premium block blob storage accounts along with a Data Lake Storage enabled account is referred to as the premium tier for Azure Data Lake Storage.

     

     

     

    Please refer to following document to see if it helps you.

    Best practices for using Azure Data Lake Storage Gen2 

    More details: Blob Storage feature support in Azure Storage accounts 

     

    Best Regards

    Community Support Team _ Polly

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

     

1 Reply

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi bcdobbs ,

    If your workloads require a low consistent latency and/or require a high number of input output operations per second (IOP), consider using a premium block blob storage account. This type of account makes data available via high-performance hardware. Data is stored on solid-state drives (SSDs) which are optimized for low latency. SSDs provide higher throughput compared to traditional hard drives. The storage costs of premium performance are higher, but transaction costs are lower, so if your workloads execute a large number of transactions, a premium performance block blob account can be economical.

    If your storage account is going to be used for analytics, we highly recommend that you use Azure Data Lake Storage Gen2 along with a premium block blob storage account. This combination of using premium block blob storage accounts along with a Data Lake Storage enabled account is referred to as the premium tier for Azure Data Lake Storage.

     

     

     

    Please refer to following document to see if it helps you.

    Best practices for using Azure Data Lake Storage Gen2 

    More details: Blob Storage feature support in Azure Storage accounts 

     

    Best Regards

    Community Support Team _ Polly

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.