Forum Discussion

Sidhant's avatar
Sidhant
Icon for Advocate V rankAdvocate V
1 year ago

Managing and Exporting High-Volume Datasets (~1M Records) in Power BI

Hello everyone, I'm currently working on a use case where I need to manage and export high-volume datasets (~1 million records) using Power BI, and I'm exploring multiple approaches. I’d appreciate ...
Need Help
Sidhant's avatar
Sidhant
Icon for Advocate V rankAdvocate V
11 months ago

Hi folks,

Thanks again for all the suggestions shared so far  they've been very helpful. However, due to several constraints in our environment (as mentioned earlier by SantoshPothnak  and myself), many of the proposed solutions aren’t feasible for us. To quickly summarize:

  • End-user focus: The export functionality is intended for external end users via an embedded Power BI report, so options like Analyze in Excel, translytical flows, and B2B sharing are not viable.

  • Tooling restrictions: Use of tools like Fabric Notebooks or external tools such as DAX Studio and Bravo is also not permitted in the current setup either due to environment policies or because they aren’t suited for end users.

Based on internal discussions and feedback from the team working on the implementation, the current acceptable path forward looks like this:

  • Provide a button or link within the embedded report to allow users to initiate a CSV export.

  • The exported file would ideally reflect filtered data (based on the report state), but even if that’s not possible, a default dataset dump is acceptable.

  • The file can be stored at a shared location where users can download it once it’s generated.

  • It’s understood that since this is a CSV export, formatting and formulas won’t be retained.

Also, we've learned that other teams working in similar constraints have gone with a parallel, report-independent export flow — for example, triggering data exports via stored procedures on Synapse using custom code in a portal. While we don't have full visibility into those implementations, it's reassuring to know this is a path others have taken successfully.

We’re continuing to explore the best way to build this within the current limits — happy to hear if anyone has optimized such an approach further.

v-hashadapu , Gabry , Poojara_D12  if you guys have any inputs please do share them (for the path that is mentioned on how to achieve the same if you have any relevant documents/videos or articles that can please do let me know)

Regards,
Sidhant.