Duplicate files in Sharepoint

[tebtim19]

I tried to create a power bi to get data that has duplicate in sharepoint.

I followed this  reference: Finding Large Duplicate Files in SharePoint (youtube.com)

Is any one know if possible to get the data for all Sharepoint site we have and add a filter per site in the view, at the moment I can only add source for the specific Sharepoint site. 

[madiicore]

Hi! If you are open to using a tool to manage storage in SharePoint, I suggest trying out deDup. It’s great for finding and removing duplicate files in your SharePoint sites, which might be causing your storage issues. Hope this helps! 😊

[christinepayton]

Yes, you would need to use the "invoke a custom function" feature, which essentially lets you run a query using all the rows in another query (where your other query gets all sites). I have a tutorial here on how to get all sites here, you could adapt this to run your query on that.

[tebtim19]

hi thank you for the video it is really good video, but it seems like this is more on statistics for a site. What I need is for the statistics in document library to find a duplicate files. Is it possible to achieve this using this method? 

I would like to achive something like this (See screenshot below) but for all document library in our tenant.  

[christinepayton]

No, so what I was getting at with linking the video is that in the video, it does a query to get all sites and then invokes a function on that list of sites. So what you would do is combine the technique from your original video and adjust it to run the same query in a function over the list of sites in the second video. I don't know of a source that has both techniques combined in one tutorial - you have to take bits and pieces and mush them together. 🙂