Help with Web Scrap

[TonyL507]

Hi All,

Could anyone help me get some code together to scrape the table from this website: https://www.cmegroup.com/market-data/cme-group-benchmark-administration/term-sofr.html It's the table in the "Term SFOR Values" table - it seems like it should be easy, but I cannot get it to work... If possible, I'd like to use the "Web.Contents" command, not the "Web.BrowserContents"- that way, it will work on the PowerBI service without a Gateway. 

My desired output looks like this:

DATE	1 MONTH	3 MONTH	6 MONTH	12 MONTH	OVERNIGHT	INDEX	30-DAY AVG (%)	90-DAY AVG (%)	180-DAY AVG (%)
10-Nov-22	3.7943	4.2653	4.6216	4.9085	-	1.0539	3.2177	2.7539	2.0664
9-Nov-22	3.7958	4.2576	4.6223	4.9176	3.7800	1.0538	3.1933	2.7371	2.0496
8-Nov-22	3.7989	4.2202	4.6048	4.9288	3.7800	1.0537	3.1689	2.7203	2.0328
7-Nov-22	3.8013	4.2103	4.5988	4.9295	3.7800	1.0535	3.1445	2.7037	2.0160
4-Nov-22	3.8067	4.2065	4.5993	4.9351	3.8000	1.0532	3.0690	2.6527	1.9651

Any help or advice on what I am doing wrong would be much appreciated! 

[TonyL507]

Thanks for the note - Python a bit beyond my capacity... I am a CPA, not a IT guy. Are there any good recommendations for having this work done? Upwork or something along those lines? I feel like if you knew what you were doing, this would be a 1-2 hour task - I'd pay someone via paypal or something... Any recomendations would be much apprecaited. 

[v-yalanwu-msft]

Hi, @TonyL507 ;

According to the offical document, Limitations on Web connector authentication for HTML content.

Troubleshooting the Power Query Web connector - Power Query | Microsoft Learn

or 

You could try using python scripts to scrape the web text and then get the data from the python script at PowerBI.

I know there is such a way, You can search the web for relevant information to help you

refer:
https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-python-scripts

Best Regards,
Community Support Team _ Yalan Wu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.