Forum Discussion

Tiolan's avatar
Tiolan
Frequent Visitor
9 years ago
Solved

Big file needs no update

There's 2Gb file "Sales2011-2016", containing data from last 5 years. It doesn't need to be updated.
And the second one "Sales2017". It must be updated every day.

 

If i append these two tabled in Query Editor, it starts to update both files, and it is VERY LONG PROCESS...

 

Is it possible to make it faster?

 

Big one:

let
Source = Json.Document(File.Contents("\\nas-01.ktc.local\Shara\PowerBi\mosntro\bi_sales_2011-2016.json")),
#"Развернутый элемент Column1" = Table.ExpandRecordColumn(Table.FromList(Source[Data], Splitter.SplitByNothing(), null, null, ExtraValues.Error), "Column1", {"ПериодСекунда", "Registrator", "Номенклатура", "Склад", "Manager", "Подразделение", "Партнер", "Выручка", "Количество", "Себестоимость"}, {"Момент часу", "Документ", "НоменклатураUUID", "СкладUUID", "Менеджер", "ПідрозділUUID", "ПартнерUUID", "Виручка", "Кількість", "Собівартість"}),
#"Добавленный запрос" = Table.Combine({#"Развернутый элемент Column1", #"Продажі 2017"})
in
#"Добавленный запрос"

Small one:

let
    Source = Json.Document(Web.Contents("http://ws-01.ktc.local:5000/ue/ver1/bi_sales/transfer", [Timeout=#duration(0, 0, 10, 0)])),
    #"Развернутый элемент Column1" = Table.ExpandRecordColumn(Table.FromList(Source[Data], Splitter.SplitByNothing(), null, null, ExtraValues.Error), "Column1", {"ПериодСекунда", "Registrator", "Номенклатура",     "Склад",     "Manager",  "Подразделение", "Партнер",     "Выручка", "Количество", "Себестоимость"},                      {"Момент часу",            "Документ",    "НоменклатураUUID", "СкладUUID", "Менеджер", "ПідрозділUUID", "ПартнерUUID", "Виручка", "Кількість",  "Собівартість"})
in
    #"Развернутый элемент Column1"
  • I decide not to use Append, but having two divided tables instead.

    And using measures for suming the values :)

5 Replies