Don't miss your chance to take the Fabric Data Engineer (DP-600) exam for FREE! Find out how by attending the DP-600 session on April 23rd (pacific time), live or on-demand.
Learn moreNext up in the FabCon + SQLCon recap series: The roadmap for Microsoft SQL and Maximizing Developer experiences in Fabric. All sessions are available on-demand after the live show. Register now
The goal is to have weekly sent CSV file loaded into SharePoint and with automated refresh data model. As I receive the raw CSV files, they come already comma delimited. There are instances where the cleansing is needed so that is done within the file and Text to Column delimited by comma to complete for each file. Each file has all of the same column headers, all file types are same, and all Text to Columns delimited by comma have been done within CSV file prior to loading PBIX. Each file tab + name is different because it is saved into SharePoint by date (ex: 20241018.SharePoint_Data / 20241023.SharePoint_Data). Below is a function should help me merge the files together but is resulting in the current output.
= Table.TransformColumns(#"Filtered Rows",{"Content", each Table.PromoteHeaders(Csv.Document(_))})
Current Output = Please see screenshot. Notice Lines #39 / 40 / 41 vs #42 / 43 / 44
Expected Output = Both files should merge together and look like lines #42 / 43 / 44
Your advice is greatly appreciated.
The goal is to have all rows like #42 / 43 / 44
Solved! Go to Solution.
@lbendlin thank you for your advice and support. After alot of trial and error, I changed the SharePoint function from "SharePoint.Files()" >> to "SharePoint.Contents()". Once that was completed, combining the Binary contents together resulted in the expected output.
You need to "Ignore quoted line breaks" when you ingest the CSVs
@lbendlin thank you for your advice and support. After alot of trial and error, I changed the SharePoint function from "SharePoint.Files()" >> to "SharePoint.Contents()". Once that was completed, combining the Binary contents together resulted in the expected output.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.
| User | Count |
|---|---|
| 46 | |
| 43 | |
| 39 | |
| 19 | |
| 15 |
| User | Count |
|---|---|
| 68 | |
| 67 | |
| 31 | |
| 27 | |
| 24 |