Forum Discussion

MXSven's avatar
MXSven
Helper I
3 years ago

Caching queries for re-use

Hi everybody,

I created the following query structure 

 

The query module "importer" is base for further subsequent "linked" query modules
and by doing so I exptected the excel file import only to happen once.

 

But it seems to me that the excel file importing (~2k files) is happening various times

Is there a way to cache the import within "importer" to speed up the 
overall processing time ?

 

Need Help

5 Replies

  • lbendlin's avatar
    lbendlin
    Super User
    3 years ago

    Read about Table.Buffer() and Binary.Buffer() .  Make sure you have enough RAM.

    • MXSven's avatar
      MXSven
      Helper I
      3 years ago

      Hi Ibendlin,

      I gave it a try as following

       

      but it did't bring the desired effect.
      Still importing all files various times.
      Any suggestions ?

    • MXSven's avatar
      MXSven
      Helper I
      3 years ago

      thanks.

      It helped me, to understand the power query engine in this regard.

      ".....If you use Table.Buffer inside the Call Web Service query it will indeed buffer the result of the call to the web service into memory, but the data that is buffered cannot be shared between separate query executions..."


      Unfortunately I wasn't able to find a solution for my problem

      • lbendlin's avatar
        lbendlin
        Super User
        3 years ago

        Use a dataflow or a "golden" dataset that implements your logic once.