Forum Discussion
Best Practice for Exporting Large Data Tables?
Hey all,
I have a table I created that produces 3.6M records that I need to export, I've been trying all day but PBI is randomly dropping data and for the life of me I cannot determine why. I've even tried reducing my date filters to small ranges and still, PBI drops data when copy/pasting.
For example, I have the raw table here listed one order where I am trying to figure out why I'm losing data.
Correct data:
Then this is after the export
Bad Data:
I've changed my ranges from two months, to one, to weeks...data drops. I thought maybe it's something with this order, but it's others too. Well that and the first image cleary shows it in the raw data before export.
Is there a way I can query/filter this [non PowerQuery generated] table from Excel? Or Access? MSSQL? I also downloaded DaxStudio but am trying to figure out how to simply filter a table for export rather than create dax queries.
Any help is very much needed, if I wasn't already fairly bald I'd be pulling out hairs by now.
Thanks fella datanaughts
DU
Got a bit of a work around:
- Connect table to DaxStudio
- Evaluate whole table
- Export whole table via text document
- Import into Access
- Filter as desired and export
3 Replies
- JirkaZSolution Specialist
What about using Analyze in Excel for that matter?
- DataUsurperHelper II
I cannot because the data exceeds Excel's max limit of records, the table I am attempting to export w.out copying and pasting is 3.4m records.
- DataUsurperHelper II
Got a bit of a work around:
- Connect table to DaxStudio
- Evaluate whole table
- Export whole table via text document
- Import into Access
- Filter as desired and export