sara_sanchez's avatar
sara_sanchez
New Member
5 years ago
Status:
Needs Votes

Add folder specific filtering to SharePoint Online List connector (before connecting to data)

Now, the connector tries to retrieve all the information related to all the files and folders in your SharePoint Online List and, afterwards, you can use filters to keep only the files/folders you are interested in. This is extremely inefficient for big libraries, and you get time out errors after 5+ hours trying to connect to data. It would be nice to be able to select the folders from which you want to extract information before actually connecting to data, so that the connector sends the minimum necessary requests to the API. Due to this time out problem, we have had to resort to creating a custom connector that uses Azure Functions and Azure Data Factory to obtain the information from SharePoint, as explained in this blog article: https://www.clearpeaks.com/advanced-sharepoint-indexer-innohub/

Recent ideas