Forum Discussion

Tiolan's avatar
Tiolan
Frequent Visitor
9 years ago
Solved

Big file needs no update

There's 2Gb file "Sales2011-2016", containing data from last 5 years. It doesn't need to be updated. And the second one "Sales2017". It must be updated every day.   If i append these two tabled in...
Need Help
  • Tiolan's avatar
    Tiolan
    9 years ago

    I decide not to use Append, but having two divided tables instead.

    And using measures for suming the values :)

Tiolan's avatar
Tiolan
Frequent Visitor
9 years ago

Yes :)

But what can we do?

 

What is the best practice to get big files updated?

What is the ways ro make updating faster?

 

  • ImkeF's avatar
    ImkeF
    Community Champion
    9 years ago

    Unfortunately I see no possibility to speed this up.

    You can try different file formats (instead of JSON), but this is just a vague guess out of desparation :-) Haven't tested these out (maybe csv or txt - don't try xls, that's much slower !!)

     

    Help finding supporters for bugfix. I tried to do my best on Twitter: https://twitter.com/TheBIccountant/status/818933857445617665

    • Tiolan's avatar
      Tiolan
      Frequent Visitor
      9 years ago

      I decide not to use Append, but having two divided tables instead.

      And using measures for suming the values :)

      • ImkeF's avatar
        ImkeF
        Community Champion
        9 years ago

        Then you're good to go: Just deselect "Include in Report Refresh" in the query-editor and load to datamodel :-) This will work & will not be refreshed (at least not on my machine).

         

        (A UNION in DAX is the current workaround for the append)