PDFs from Sharepoint to Fabric

[danitskofabric]

So I have PDFs that are uploaded to Sharepoint and I need to access them inside a Notebook. I cant copy them via Power Automate doing to policys. Any ideas on how to handle this?

Thank you!

[gaya3krishnan86]

Use graph apis in Fabric notebook and save the PDFs to lakehouse files section using Python file writing methods. Make sure to mount the desired lakehouse using notebookutils and use the returned mount path for Python file write methods. Works like a charm.

[v-kpoloju-msft · Accepted solution]

Hi @danitskofabric,

Thank you for reaching out to the Microsoft Fabric Community Forum. Also, thanks to @tayloramy, for those inputs on this issue.

I understand the challenge, you have got PDFs sitting in SharePoint that you would like to work with directly inside a Fabric Notebook, but Power Automate isn’t an option due to policy restrictions.

Use the SharePoint/OneDrive connector in Fabric to pull the PDFs into your Lakehouse. Once they’re there, you can process them in your Notebook with Python libraries like PyPDF2 or pymupdf.
https://learn.microsoft.com/en-us/fabric/data-factory/connector-sharepoint-folder-overview 
https://learn.microsoft.com/en-us/fabric/data-factory/connector-sharepoint-online-list 
https://learn.microsoft.com/en-us/fabric/data-factory/connector-sharepoint-folder 

If your org allows API access, you can use the Microsoft Graph API inside your Notebook to read the files directly from SharePoint. Here’s a starting point:
https://learn.microsoft.com/en-us/graph/api/resources/onedrive?view=graph-rest-1.0 

If this is a one-off, you can also manually upload the PDFs into your Lakehouse and process them from there.

Hope this clears it up. Let us know if you have any doubts regarding this. We will be happy to help.

Thank you for using the Microsoft Fabric Community Forum.

[v-kpoloju-msft]

Hi @danitskofabric,

Just checking in to see if the issue has been resolved on your end. If the earlier suggestions helped, that’s great to hear! And if you’re still facing challenges, feel free to share more details happy to assist further.

Thank you.

[v-kpoloju-msft]

Hi @danitskofabric,

Hope you had a chance to try out the solution shared earlier. Let us know if anything needs further clarification or if there's an update from your side always here to help.

Thank you.

[v-kpoloju-msft]

Hi @danitskofabric,

Just wanted to follow up one last time. If the shared guidance worked for you, that’s wonderful hopefully it also helps others looking for similar answers. If there’s anything else you'd like to explore or clarify, don’t hesitate to reach out.

Thank you.

[tayloramy]

Hi @danitskofabric, 

Are you able to copy them into a Lakehouse using a Pipeline? 

If you found this useful, consider giving Kudos. If I solved your problem, mark this post as the solution.  

[danitskofabric]

Hi @tayloramy,

As I saw that only supports Sharepoint-Online-Lists, but I need to copy Files that are inside Sharepoint-Online Folders.

[tayloramy]

Hi @danitskofabric, 

When you select a SharePoint Online List connection in the Pipeline, you are able to select a connection type of SharePoint Online File. This is currently in preview. 

If you found this useful, consider giving Kudos. If I solved your problem, mark this post as the solution. 

[danitskofabric]

Thank you, I didn't saw that! I now created a Service Principal and gave it access to the Sharepoint Site. If I test the connection for Sharepoint Online List it works, but if i choose Sharepoint Online File and test the connection it doesn't. Does the SP needs more Permission?

[tayloramy]

Hi @danitskofabric, 
How was the service principle granted access to the site? 
I've noticed some workloads in Fabric require permissions to be granted the legacy way on the site itself, not in Azure. This needs ot be done through the https://[your_site_url]/_layouts/15/appinv.aspx page on your site. 
If you found this useful, consider giving Kudos. If I solved your problem or answered your question, mark this post as the solution. 

[danitskofabric]

Hi @tayloramy,

yes the permission was granted via the appinv.aspx page. Is it possible that the SP needs Sharepoint API permission for files?

[tayloramy]

Hi @danitskofabric, 
It's possible that more permissions are needed, it's also possible that something just isn't working with this feature as it's still in preview. 

I will see if I can find some time to test this in my environment today and see what I can get to work. 

If you found this useful, consider giving Kudos. If I solved your problem or answered your question, mark this post as the solution.