Forum Discussion

IgorCanabarro's avatar
IgorCanabarro
Regular Visitor
5 years ago
Solved

SQL table buffer

Hello, I am having difficult to set up a buffer to a merged table from SQL server. The table has more than 600k lines and  I need to merge info with a csv table I work on.

 

I have tried the following:

= Table.NestedJoin(#"Tipo Alterado", {"ID Fluig"}, Table.Buffer(TPRODUTO), {"CODIGOAUXILIAR"}, "TPRODUTO", JoinKind.LeftOuter)

 

when I do it my Power BI freezes, and I need to reset.

 

Can you help me understand what I am doing wrong?

Need Help
  • ImkeF's avatar
    ImkeF
    5 years ago

    Hi IgorCanabarro ,

    a buffer won't help you for that, because it would drag the data anyway once your refresh the pbix (or in the service).

    If your SQL has different refresh intervals than the csv and your SQL-table is filtered, then moving to a dataflow for your SQL import could improve. But not sure with your table length. You can set a different schedule there and then import it to PBI to merge with the CSV.
    Do your sources live in in the cloud already? Then moving everything to a dataflow could also be a solution, especially if limited resources on your PC or slow internet connection are the reason for slow refresh.

     

     

3 Replies

  • ImkeF's avatar
    ImkeF
    Icon for Community Champion rankCommunity Champion
    5 years ago

    Hi IgorCanabarro ,

    a buffer won't help you for that, because it would drag the data anyway once your refresh the pbix (or in the service).

    If your SQL has different refresh intervals than the csv and your SQL-table is filtered, then moving to a dataflow for your SQL import could improve. But not sure with your table length. You can set a different schedule there and then import it to PBI to merge with the CSV.
    Do your sources live in in the cloud already? Then moving everything to a dataflow could also be a solution, especially if limited resources on your PC or slow internet connection are the reason for slow refresh.

     

     

  • ImkeF's avatar
    ImkeF
    Icon for Community Champion rankCommunity Champion
    5 years ago

    Hi IgorCanabarro ,
    why do you want to use a buffer and which table to you want to buffer: The SQL or csv?

     

    • IgorCanabarro's avatar
      IgorCanabarro
      Regular Visitor
      5 years ago

      Hi ImkeF ! I want to buffer the SQL table because this is getting too much time when I need to update Power BI.

       

      The SQL table difficultly gets new data, but my CSV is being updated every day, and need to complement information from the SQL table.

       

      Thanks