Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The ultimate Microsoft Fabric, Power BI, Azure AI & SQL learning event! Join us in Las Vegas from March 26-28, 2024. Use code MSCUST for a $100 discount. Register Now

Reply
DLROLLINGS
Helper I
Helper I

Unpivot Multiple Columns without duplicating records

Hi all,

 

I have a link into Dynamics 365 to a data set that contains multiple columns, I am not happy about the way it has been built but I have to work with it. 

 

For each applicant there is a column for application date, application source, applicant name such as 

Application 1.Date, Application 2.Date, Application 3.Date. Application 1.Source, Application 2.Source, Application 3.Source etc etc.

 

There are 12 applicant details, although not all contain data. I have unpivoted each date type individually, CTRL+SELECT Application 1.Date, Applcation 2.Date. Application 3.Date etc but this creates multiple records of each account each time I do a new column. I have done them all individually (as in select all 12 for the relevant field) and yes this has caused a bit of an issue. The number of rows exceeds 50 million because of the duplication....infact, I think I am trying to create a file with over a trillion rows.

 

The data set has 1850 records so I have created 1850*12 for Application Date, 22,200*12 when adding the next column and I have about 12 columns. I have managed to get to a "septtillion" (21 zeros) number of rows of data...if they loaded. 

 

Thanks

1 REPLY 1
DataInsights
Super User
Super User

@DLROLLINGS,

 

Here are some solutions you may be able to adapt:

 

https://datachant.com/2019/10/11/guest-story-unpivot-pairs-of-columns/ 

 

https://community.powerbi.com/t5/Desktop/Unpivot-in-Power-Query/m-p/2186044 





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!




Helpful resources

Announcements
Fabric Community Conference

Microsoft Fabric Community Conference

Join us at our first-ever Microsoft Fabric Community Conference, March 26-28, 2024 in Las Vegas with 100+ sessions by community experts and Microsoft engineering.

Fabric Career Hub

Microsoft Fabric Career Hub

Explore career paths and learn resources in Fabric.

Fabric Partner Community

Microsoft Fabric Partner Community

Engage with the Fabric engineering team, hear of product updates, business opportunities, and resources in the Fabric Partner Community.

Power BI Header Change

Power BI Header Update

Read about the exciting updates for the Power BI forum.

Top Solution Authors