Forum Discussion
How to import tables from web?
Hi,
I need to import tables from 110 web links. Is there a way I can write a script to get those tables?
I do not want to fetch tables from one link at a time?
Example of the links are as follows:
So i want to write While Do script and use it to get the data.
Regards,
Rahul
6 Replies
- Greg_Deckler
Community Champion
What I would recommend that you do is create queries for two of the entries and then in one of the queries, merge them together. You can follow the instructions in my article here:
http://social.technet.microsoft.com/wiki/contents/articles/32915.powerbi-merge-query-with-m.aspx
Once you have the M code, then write a script to generate the M code for merging all 110 web link sources. Create a blank query and paste in the generated M code.
- Click the Microsoft Office Button , and then click Open.
- In the Look in box, locate the folder where your query file is stored.
- Select the Web query that Hadoop Training in Chennai you want to run.
- Click Open.
- In the Import Data dialog box, do one of the following:
A: You can import tables from a webpage using various tools or programming languages. One common method is using Python with the pandas library:
import pandas as pd # Replace the URL with the webpage that contains the table url = 'https://example.com/tablepage' # Read all tables from the page tables = pd.read_html(url) # Access the first table df = tables[0] print(df.head())
Notes:
pandas.read_html() works only if the table is in proper HTML <table> format.
You may need to install dependencies like lxml or html5lib with pip install lxml html5lib.
Alternatively, for non-programmers, tools like Microsoft Excel or Google Sheets can import web tables:
In Excel: Go to Data > From Web, enter the URL, and select the table.
In Google Sheets: Use =IMPORTHTML("URL", "table", index).
Visit For more information: https://www.tpointtech.com/python-tutorial
- Click the Microsoft Office Button , and then click Open.
- In the Look in box, locate Hadoop Training in Chennai the folder where your query file is stored.
- Select the Web query that Hadoop Course in Chennai you want to run.
- Click Open.
- In the Import Data dialog box, do one of the following:
Click the Data tab, then New Query > From Other Sources > From Web.
Regards: Big Data Course in Chennai | Big Data Hadoop Training | Cloud Computing Courses
Select Data > Get & Transform > From Web. Press CTRL+V to paste the URL into the text box, and then select OK. In the Navigator pane, under Display Options, select the Results table. Power Query will preview it for you in the Table View pane on the right.
Simple and easy for more info full stack developer course in bangalore - Be-practical.com
