Forum Discussion

pezwi's avatar
pezwi
Frequent Visitor
6 years ago

Only select certain columns from source

Hi,  I am new to power query and I'm trying to figure out how I can limit the data that I'm extracting from the source because I only need a couple of the columns.  For example, I'm running a web que...
General Comment
Greg_Deckler's avatar
Greg_Deckler
Community Champion
6 years ago

pezwi - Well, if this was a SQL source you could use a View or write a SQL statement but since it is a Web API you are going to be limited to the functionality of that Web API. For example, I believe ODATA allows you to specify columns/fields but not sure about just any old Web API. 

  • pezwi's avatar
    pezwi
    Frequent Visitor
    6 years ago

    I'll have to look into the Odata option.  I'm not finding a lot of examples for that.

     

    Currently I'm pulling the data into a list which is capturing all the records.  It would be great if I could do loop through the records but I'm having trouble figuring that out.

     

    Source = List.Generate(
    () => getPage(""),
    each _[scrollToken] <> null,
    each getPage(_[scrollToken]),
    each [scrollToken = _[scrollToken], records = _[records]]
    ),

    • mahoneypat's avatar
      mahoneypat
      Microsoft Employee
      6 years ago

      Here is an article I wrote last year that may help you get started with using OData.  It includes examples of adding $select and other ways to let you limit the initial amount of data returned. 

       

      https://powerpivotpro.com/2019/02/some-odata-tips/

       

      If this works for you, please mark it as the solution.  Kudos are appreciated too.  Please let me know if not.

      Regards,

      Pat