scrapping notebook python

[ludovicLaurent]

HI  

    i have created a python program on my computer to scrap an url , i works 

    but if i put in a pyspark notebook , i have a 403 error .

    I tried to add header   in the request.get command  , but same result : error 403 

    Have you some idea to solve this problem 


   my code is 

import requests

response = requests.get("https://www.proclinic.es/tienda/020-195-unitwin-roth-022-5-5-s-i-gnch-3.html")

print(response)

print(response.content)

thanks

[Anonymous]

Hi @ludovicLaurent,

Any update on this? Did the above suggestions help with your scenario? if that is the case, you can consider Kudo or Accept the helpful suggestions to help others who faced similar requirements.

If these also don't help, please share more detailed information and description to help us clarify your scenario to test.

Regards,

Xiaoxin Sheng

[Anonymous]

Hi @ludovicLaurent ,

The 403 error code meaning access to the requested resource is forbidden. (the server understood the request, but will not fulfill it, if it was correct)

HTTP 403 - Wikipedia

AFAIK, the notebook is works on the cloud-based sandbox with required environment and libraries. Did these operations require any additional authrisons or need to write data to the current local folder/file? (the pyspark notebook sandbox not allowed to operate with its physical path)

Regards,

Xiaoxin Sheng