Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now

Reply
Sam_Dixey
New Member

Load Query Based on Dynamic File Name (SharePoint)

I'm looking to ensure my Power BI report pulls the latest data from a SharePoint file without having to overwrite the current sharepoint file with the latest data.

 

Each day a new file is received and saved into the same SharePoint folder with the name (________YYYYMMDDhhmmss).xlsx. This has the exact same layout (columns, tabs, etc) as the previous file, however with the latest data.


Rather than having to copy and paste into the current file, overwrite the current file, or change the load data query each day, I'm hoping there is a way for Power BI to look in the same SharePoint folder and use the latest file.

 

I am new to Power BI so would greatly appreciate any simple instructions, clearly explained. Thanks community 🙂

1 ACCEPTED SOLUTION
jeffshieldsdev
Solution Sage
Solution Sage

Steps would be like this:

  1. Use "SharePoint folder" connector to connect to the site using the site root URL.
  2. Click "Transform Data" button in preview window.
  3. Filter Folder Path to folder contain the files (will have a trailing "/").
  4. Filter Extension column to ".xlsx" .
  5. Duplicate "Name" column, and/or Replace Values in Name column to remove filter name prefix, so remaining text is "YYYYMMDDhhmmss).xlsx"
  6. Sort "Name" column Descending
  7. Click on "Binary" in first row of "Content" column to drill into the XLSX file, then drill into the desired Sheet. NOTE: the default generated Power Query code will used hard-coded named identifiers. You may want to edit this to use index or position-based identifiers instead.

View solution in original post

9 REPLIES 9
Sam_Dixey
New Member

Thanks Jeff. And to confirm, would this have the effect that each morning Power BI will pull from the latest/top report in the folder? 

Yes, it should.  Each refresh will pull the max dated file.

jeffshieldsdev
Solution Sage
Solution Sage

Steps would be like this:

  1. Use "SharePoint folder" connector to connect to the site using the site root URL.
  2. Click "Transform Data" button in preview window.
  3. Filter Folder Path to folder contain the files (will have a trailing "/").
  4. Filter Extension column to ".xlsx" .
  5. Duplicate "Name" column, and/or Replace Values in Name column to remove filter name prefix, so remaining text is "YYYYMMDDhhmmss).xlsx"
  6. Sort "Name" column Descending
  7. Click on "Binary" in first row of "Content" column to drill into the XLSX file, then drill into the desired Sheet. NOTE: the default generated Power Query code will used hard-coded named identifiers. You may want to edit this to use index or position-based identifiers instead.

I have looked online and i still don't get how i can edit my query to make this update with a new file each day the date changes

where the next day would be ALL_SOL_2024_07_18.csv, to ALL_SOL_2024_07_19.csv

let
Source = SharePoint.Files("https://mydnb.sharepoint.com/sites/teams/na_delivery/", [ApiVersion = 15]),
#"Filtered Rows" = Table.SelectRows(Source, let latest = List.Max(Source[Date created]) in each [Date created] = latest),
#"ALL_SOL_2024_07_18 csv_https://mydnb sharepoint com/sites/teams/na_delivery/606 Fulfillment Template/UPLOAD/RRF_REPORTS/" = #"Filtered Rows"{[Name="ALL_SOL_2024_07_18.csv",#"Folder Path"="https://mydnb.sharepoint.com/sites/teams/na_delivery/606 Fulfillment Template/UPLOAD/RRF_REPORTS/"]}[Content],
#"Imported CSV" = Csv.Document(#"ALL_SOL_2024_07_18 csv_https://mydnb sharepoint com/sites/teams/na_delivery/606 Fulfillment Template/UPLOAD/RRF_REPORTS/",[Delimiter=",", Columns=14, Encoding=1252, QuoteStyle=QuoteStyle.None]),
#"Promoted Headers" = Table.PromoteHeaders(#"Imported CSV", [PromoteAllScalars=true]),
#"Changed Type" = Table.TransformColumnTypes(#"Promoted Headers",{{"SOL - ID", type text}, {"SOL - Line Sequence", Int64.Type}, {"SOL - POB", Int64.Type}, {"SOL - End Date", type date}, {"SOL - Start Date", type date}, {"SOL - Qty Ordered", Int64.Type}, {"SOL - Product Name", type text}, {"SOL - Ratable Indicator", Int64.Type}, {"SOL - Description", type text}, {"SOL - OA Nbr", Int64.Type}, {"SOL - Manual Subsequent Indicator", Int64.Type}, {"SOL - Unit Type", type text}, {"SOL - Source DID", type text}, {"SOL_is_cancelled", type text}})
in
#"Changed Type"

Anonymous
Not applicable

Won't clicking on "Binary" result in a series of steps where the File Name is hard-coded?

Good point.  The default generated Power Query will--but you can edit it to use index-based identifiers instead of named ones.

Anonymous
Not applicable

Thank you for your confirmation! 
May I also ask how to revise the code to use index-based identifiers in the following auto-generated steps?

= #"Filtered Rows"{[Name="Products.xlsx",#"Folder Path"="https://sharepoint.com/sites/References/"]}[Content]

 

= Excel.Workbook(#"Products xlsx_https://sharepoint.com/sites/References/")

The row filtering criteria is embedded in the #"Filter Rows" step. You'll need to move this logic into step(s) before #"Filtered Rows", filtering to just one row, and then selecting it.

Something like this:

let
    Source = SharePoint.Files("https://sharepoint.com/", [ApiVersion = 15]),
    #"Filtered Rows" = Table.SelectRows(Source, each [Name] = "Filename" and [Folder Path] = "URL"),
    Content = #"Filtered Rows"{0}[Content],
    #"Imported Excel Workbook" = Excel.Workbook(Content)
in
    #"Imported Excel Workbook"

 

this works! thank you so much!

Helpful resources

Announcements
November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Live Sessions with Fabric DB

Be one of the first to start using Fabric Databases

Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.

Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.

Nov PBI Update Carousel

Power BI Monthly Update - November 2024

Check out the November 2024 Power BI update to learn about new features.