Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
DLROLLINGS
Helper I
Helper I

Unpivot Multiple Columns without duplicating records

Hi all,

 

I have a link into Dynamics 365 to a data set that contains multiple columns, I am not happy about the way it has been built but I have to work with it. 

 

For each applicant there is a column for application date, application source, applicant name such as 

Application 1.Date, Application 2.Date, Application 3.Date. Application 1.Source, Application 2.Source, Application 3.Source etc etc.

 

There are 12 applicant details, although not all contain data. I have unpivoted each date type individually, CTRL+SELECT Application 1.Date, Applcation 2.Date. Application 3.Date etc but this creates multiple records of each account each time I do a new column. I have done them all individually (as in select all 12 for the relevant field) and yes this has caused a bit of an issue. The number of rows exceeds 50 million because of the duplication....infact, I think I am trying to create a file with over a trillion rows.

 

The data set has 1850 records so I have created 1850*12 for Application Date, 22,200*12 when adding the next column and I have about 12 columns. I have managed to get to a "septtillion" (21 zeros) number of rows of data...if they loaded. 

 

Thanks

1 REPLY 1
DataInsights
Super User
Super User

@DLROLLINGS,

 

Here are some solutions you may be able to adapt:

 

https://datachant.com/2019/10/11/guest-story-unpivot-pairs-of-columns/ 

 

https://community.powerbi.com/t5/Desktop/Unpivot-in-Power-Query/m-p/2186044 





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

July 2024 Power BI Update

Power BI Monthly Update - July 2024

Check out the July 2024 Power BI update to learn about new features.

July Newsletter

Fabric Community Update - July 2024

Find out what's new and trending in the Fabric Community.