Help with Web Scrap

Question

Hi All,&nbsp;Could anyone help me get some code together to scrape the table from this website:&nbsp;https://www.cmegroup.com/market-data/cme-group-benchmark-administration/term-sofr.html It's the table in the "Term SFOR Values" table - it seems like it should be easy, but I cannot get it to work... If possible, I'd like to use the "Web.Contents" command, not the "Web.BrowserContents"- that way, it will work on the PowerBI service without a Gateway.&nbsp;&nbsp;My desired output looks like this:DATE1&nbsp;MONTH3&nbsp;MONTH6&nbsp;MONTH12&nbsp;MONTHOVERNIGHTINDEX30-DAY AVG&nbsp;(%)90-DAY AVG&nbsp;(%)180-DAY AVG&nbsp;(%)10-Nov-22&nbsp;&nbsp;&nbsp; 3.7943&nbsp;&nbsp;&nbsp; 4.2653&nbsp;&nbsp;&nbsp; 4.6216&nbsp;&nbsp;&nbsp; 4.9085&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1.0539&nbsp;&nbsp;&nbsp; 3.2177&nbsp;&nbsp;&nbsp; 2.7539&nbsp;&nbsp;&nbsp; 2.06649-Nov-22&nbsp;&nbsp;&nbsp; 3.7958&nbsp;&nbsp;&nbsp; 4.2576&nbsp;&nbsp;&nbsp; 4.6223&nbsp;&nbsp;&nbsp; 4.9176&nbsp;&nbsp;&nbsp; 3.7800&nbsp;&nbsp;&nbsp; 1.0538&nbsp;&nbsp;&nbsp; 3.1933&nbsp;&nbsp;&nbsp; 2.7371&nbsp;&nbsp;&nbsp; 2.04968-Nov-22&nbsp;&nbsp;&nbsp; 3.7989&nbsp;&nbsp;&nbsp; 4.2202&nbsp;&nbsp;&nbsp; 4.6048&nbsp;&nbsp;&nbsp; 4.9288&nbsp;&nbsp;&nbsp; 3.7800&nbsp;&nbsp;&nbsp; 1.0537&nbsp;&nbsp;&nbsp; 3.1689&nbsp;&nbsp;&nbsp; 2.7203&nbsp;&nbsp;&nbsp; 2.03287-Nov-22&nbsp;&nbsp;&nbsp; 3.8013&nbsp;&nbsp;&nbsp; 4.2103&nbsp;&nbsp;&nbsp; 4.5988&nbsp;&nbsp;&nbsp; 4.9295&nbsp;&nbsp;&nbsp; 3.7800&nbsp;&nbsp;&nbsp; 1.0535&nbsp;&nbsp;&nbsp; 3.1445&nbsp;&nbsp;&nbsp; 2.7037&nbsp;&nbsp;&nbsp; 2.01604-Nov-22&nbsp;&nbsp;&nbsp; 3.8067&nbsp;&nbsp;&nbsp; 4.2065&nbsp;&nbsp;&nbsp; 4.5993&nbsp;&nbsp;&nbsp; 4.9351&nbsp;&nbsp;&nbsp; 3.8000&nbsp;&nbsp;&nbsp; 1.0532&nbsp;&nbsp;&nbsp; 3.0690&nbsp;&nbsp;&nbsp; 2.6527&nbsp;&nbsp;&nbsp; 1.9651&nbsp;Any help or advice on what I am doing wrong would be much appreciated!&nbsp;

v-yalanwu-msft · Answer

Hi,&nbsp;TonyL507&nbsp;;
According to the offical document,&nbsp;Limitations on Web connector authentication for HTML content.

Troubleshooting the Power Query Web connector - Power Query | Microsoft Learn
or&nbsp;
You could try using python scripts to scrape the web text and then get the data from the python script at PowerBI.
&nbsp;
I know there is such a way, You can search the web for relevant information to help you
refer:https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-python-scripts
Best Regards,Community Support Team _ Yalan WuIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

tonyl507 · Answer

Thanks for the note - Python a bit beyond my capacity... I am a CPA, not a IT guy. Are there any good recommendations for having this work done? Upwork or something along those lines? I feel like if you knew what you were doing, this would be a 1-2 hour task - I'd pay someone via paypal or something... Any recomendations would be much apprecaited.&nbsp;

Forum Discussion

Help with Web Scrap

2 Replies

Related content

Trying to calculate scrap rate %

scrapping facebook pages data

Web Scrapping

Weekly Scrap Percent of Gross Production

Excel scrap cost formula as Power Bi Measure

DATE	1 MONTH	3 MONTH	6 MONTH	12 MONTH	OVERNIGHT	INDEX	30-DAY AVG (%)	90-DAY AVG (%)	180-DAY AVG (%)
10-Nov-22	3.7943	4.2653	4.6216	4.9085	-	1.0539	3.2177	2.7539	2.0664
9-Nov-22	3.7958	4.2576	4.6223	4.9176	3.7800	1.0538	3.1933	2.7371	2.0496
8-Nov-22	3.7989	4.2202	4.6048	4.9288	3.7800	1.0537	3.1689	2.7203	2.0328
7-Nov-22	3.8013	4.2103	4.5988	4.9295	3.7800	1.0535	3.1445	2.7037	2.0160
4-Nov-22	3.8067	4.2065	4.5993	4.9351	3.8000	1.0532	3.0690	2.6527	1.9651