Forum Discussion

tebtim19's avatar
tebtim19
Icon for Helper IV rankHelper IV
2 years ago

Duplicate files in Sharepoint

I tried to create a power bi to get data that has duplicate in sharepoint.

I followed this  reference: Finding Large Duplicate Files in SharePoint (youtube.com)

Is any one know if possible to get the data for all Sharepoint site we have and add a filter per site in the view, at the moment I can only add source for the specific Sharepoint site. 

 

 

 

4 Replies

  • christinepayton's avatar
    christinepayton
    Icon for Most Valuable Professional rankMost Valuable Professional

    Yes, you would need to use the "invoke a custom function" feature, which essentially lets you run a query using all the rows in another query (where your other query gets all sites). I have a tutorial here on how to get all sites here, you could adapt this to run your query on that.

    • tebtim19's avatar
      tebtim19
      Icon for Helper IV rankHelper IV

      hi thank you for the video it is really good video, but it seems like this is more on statistics for a site. What I need is for the statistics in document library to find a duplicate files. Is it possible to achieve this using this method? 

       

      I would like to achive something like this (See screenshot below) but for all document library in our tenant.  

       

       



      • christinepayton's avatar
        christinepayton
        Icon for Most Valuable Professional rankMost Valuable Professional

        No, so what I was getting at with linking the video is that in the video, it does a query to get all sites and then invokes a function on that list of sites. So what you would do is combine the technique from your original video and adjust it to run the same query in a function over the list of sites in the second video. I don't know of a source that has both techniques combined in one tutorial - you have to take bits and pieces and mush them together. πŸ™‚

  • Hi! If you are open to using a tool to manage storage in SharePoint, I suggest trying out deDup. It’s great for finding and removing duplicate files in your SharePoint sites, which might be causing your storage issues. Hope this helps! πŸ˜Š