Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
Anonymous
Not applicable

Issues Tracking Data Model

We have an issue tracking log sent via an automatic email every hour of the day as a .xlsx file.  Each file is dated in the file name and tables have the following format.

Unique IDPL IdentifierDate CreatedDate ReviewedDate ClosedCompanyStatusLocation
A unique value to each issueAn identifier number that may be duplicate due to multiple devices possibly offline when created   Assigned company to resolve issueIssued,Work Required,Ready for Review, Ready to Close, In Dispute,ClosedFloor>Room No.

 

I would like to create a table showing the changes on a daily basis for each Company on a daily basis showing both the quantity of total items along with the difference between the current and previous day.

 

My current process was to have all the files kept on a sharepoint folder and I was able to query the 1PM report for each day and then combined all the reports into a single table.  I then used a pivot table to create the matrix but I cant create a difference off of a pivot table.  Also loading times are extremely long (10+ minutes), assuming due to the method I am using and the quantity of rows per excel file (25k+ rows).

 

What would be a better approach to create a delta table and reduce the loading time?

3 REPLIES 3
lbendlin
Super User
Super User

Load the Excel data into a database like SQL Server. Include the file name so you know where each row came from.

Anonymous
Not applicable

Unfortunately we dont have access to upload to a SQL server.  Any other possible solutions?

Place the Excel files on a OneDrive. Then access them via the Sharepoint Folder connector.

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

October Power BI Update Carousel

Power BI Monthly Update - October 2025

Check out the October 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.