Forum Discussion

DataUsurper's avatar
DataUsurper
Helper II
6 years ago
Solved

Best Practice for Exporting Large Data Tables?

Hey all,

 

I have a table I created that produces 3.6M records that I need to export, I've been trying all day but PBI is randomly dropping data and for the life of me I cannot determine why. I've even tried reducing my date filters to small ranges and still, PBI drops data when copy/pasting.

 

For example, I have the raw table here listed one order where I am trying to figure out why I'm losing data.
Correct data:

 

Then this is after the export
Bad Data:

 

 

I've changed my ranges from two months, to one, to weeks...data drops. I thought maybe it's something with this order, but it's others too. Well that and the first image cleary shows it in the raw data before export.

Is there a way I can query/filter this [non PowerQuery generated] table from Excel? Or Access? MSSQL? I also downloaded DaxStudio but am trying to figure out how to simply filter a table for export rather than create dax queries. 

Any help is very much needed, if I wasn't already fairly bald I'd be pulling out hairs by now.
Thanks fella datanaughts

DU

  • DataUsurper's avatar
    DataUsurper
    6 years ago

    Got a bit of a work around:

    1. Connect table to DaxStudio
    2. Evaluate whole table
    3. Export whole table via text document
    4. Import into Access
      1. Filter as desired and export

3 Replies

  • JirkaZ's avatar
    JirkaZ
    Solution Specialist

    What about using Analyze in Excel for that matter?

    • DataUsurper's avatar
      DataUsurper
      Helper II

      I cannot because the data exceeds Excel's max limit of records, the table I am attempting to export w.out copying and pasting is 3.4m records.

      • DataUsurper's avatar
        DataUsurper
        Helper II

        Got a bit of a work around:

        1. Connect table to DaxStudio
        2. Evaluate whole table
        3. Export whole table via text document
        4. Import into Access
          1. Filter as desired and export