Forum Discussion
Web scrapping full data into a table - including load more
Hello friends, am trying to do scrapping of a retail website and when I do the scrapping I can get only the data seen in the screen for example if there are only 10 items on the screen only those...
Hi sekar, i just tried a page with 'load more' and it works as it is. can you share an example of the output you are getting? the 'load more' does not restrict like 'next page' which typically has a different URL to extract the rest of the rows from the table. Hence, when just 'load more', powerbi should be able to scrap the whole table even if it needs multiple clicks of 'load more' when you review the webpage manually. But you mentioned, you are trying to scrap amazon.com which I believe has an infinity scroll. Behavior needs to be evaluated but can do and share feedback here if works.
Thanks
Sagnik