Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
6 years ago

Not able to load all the rows from web to Query Editor

Hi,

 

I am trying to load historical stock data from Yahoo to power BI using web URL https://au.finance.yahoo.com/quote/%5EAXJO/history?period1=722476800&period2=1585353600&interval=1d&filter=history&frequency=1d

 

When I load the data to query editor, it loads only first 100 rows even though it has more than 5000 records. 

 

 

Can anyone help me with the hack to load all the records from that URL?

 

My final goal is to get dynamic stock data into Power BI. 

 

Thank you

7 Replies

    • edhans's avatar
      edhans
      Icon for Community Champion rankCommunity Champion

      I'm kinda stumped. As you scroll that page, the browser is making additional calls to the site, which is returning more data and returning more advertising. It seems to be limiting it intentionally.

       

      One thing you could do is download the CSV file and use that as one table, then download these 100 records as the most recent, then combine into one table and eliminate those in the CSV via an anti-merge, but you'd have to redownload the CSV file every 100 business days or so to keep it going. Not at all ideal....

      • Anonymous's avatar
        Anonymous
        Not applicable

        Yes, I could do that. But as I add more stocks, I need to download CSV file for each stock every time I want to update. 

         

        I want to make it completely automatic.