Forum Discussion
Dataflow gen2 - Staging Storage cost confusion
Hi Max_701,
Your understanding is correct: with staging enabled in Dataflow Gen2, intermediate data is stored in OneLake and billed separately from your Fabric capacity, based on standard Azure Data Lake Storage Gen2 rates (such as about $0.023/GB/month for hot storage in most regions). Fabric capacity (F-SKU) only covers compute, not storage. Additionally, enabling staging may increase compute usage, as Dataflow Gen2 could use High Scale Dataflow or SQL engine compute during refresh, which is billed against your Fabric capacity. This setup does not result in double billing; instead, compute and storage are billed as separate components. Staged data is billed for storage in the same way as any other Lakehouse or Warehouse data.
Thank you.
Thanks for your response, could you please direct me towards where exact could I find this information in MS docs - I am struggling to find it in one place!
You already have the link
https://learn.microsoft.com/en-us/fabric/data-factory/pricing-dataflows-gen2
When you refresh or publish a Dataflow Gen2 item, Fabric Capacity Units are consumed for the following engines:
- Standard Compute: You're charged for it based on the query evaluation time across all your Dataflow queries that run through the Mashup engine.
- High Scale Dataflow Compute: You're charged when staging is enabled, based on Lakehouse (Staging storage) and Warehouse (Storage Compute) SQL engine consumption duration.
- Fast Copy: You're charged when fast copy connectors are enabled and can be used in the Dataflow, based on copy job duration.
https://learn.microsoft.com/en-us/fabric/data-factory/pricing-overview.
If this post helps, then please appreciate giving a Kudos or accepting as a Solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!
I think there is a confusion - link I provided talks about compute cost but not storage cost, which is what I am asking for.
Hi Max_701 ,
Please use this link for storage cost
https://azure.microsoft.com/en-us/pricing/details/microsoft-fabric/
And the other link for DataFLow cost and combine them together to get the final cost
Ok so this is the same link I referred for the original query & which is why I put that number $0.023 - does that mean my original understanding was correct( because billing is separate & the cost is what I assumed as per your last link) because your first response mentioned that it was only partly correct, could you please clarify what is that I am missing here.