Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now

Reply
vgheorghe
New Member

Power quedoury refresh duplicating rows

Hi,

 

I have an issue with the refresh in power query. I use a "get data from folder" option, and in this folder i store data for each month that has passed. I have run today the refresh and it doubles the data for July, but only for this one. All the other months are looking ok. Can someone help with an advice? Have no ideea from where to begin as i did not do any change to the power query...

 

Thank you

1 ACCEPTED SOLUTION

Hi,

 

I have copied the data from the original source file, paste it into a new one and upload this one. All looks good.

Weird....

 

Thanks

View solution in original post

4 REPLIES 4
jwin2424
Resolver I
Resolver I

I had this same issue. It would duplicate a few files, but not all of them. When you expand the tables, a custom kind shows up as a new column. Under custom kind, I had Sheet and DefinedName as the values. I filtered only to show data with the value Sheet (the name of the sheet in the excel file itself) and it resolved the issue. 

jwin2424_0-1708646230237.png

 

edhans
Super User
Super User

Just to ensure there is nothing buggy in the Power Query cache, clear it.

  • File
  • Options and Settings
  • Options
  • Data Load in Global Section
  • Clear Cache

I doubt that is it though, but the easiest to check.

 

Otherwise there are two possiblities I can think of:

  • You have a merge in your queries that is causing the duplication. You may have the July dates, invoices, records, whatever, twice in another table you are merging with this table, and that will duplicate the data. Check any tables are are merging.
  • Your source data actually has the data twice. For example, when you created your July data, you accidentally did it twice and appended it, or your June data is really June and July.

You'll need to work back through your data and queries to find this issue. I am 99.99999999999% sure this is not a bug in Power Query, but a source data issue or a merge issue.



Did I answer your question? Mark my post as a solution!
Did my answers help arrive at a solution? Give it a kudos by clicking the Thumbs Up!

DAX is for Analysis. Power Query is for Data Modeling


Proud to be a Super User!

MCSA: BI Reporting

Hi,

 

@edhans: thank you for your reply

 

I also think there is a problem with the source as i have done the refresh on an older version of my power query, and it doubles the data as well. So, any change that i have done since then, is not the cause. There is no merge and the source does not have double rows.

 

I have also done the refresh without the issue file and all goes well. I will try to extract the data again and replace the file, see what is happening.

 

Have a great day

Hi,

 

I have copied the data from the original source file, paste it into a new one and upload this one. All looks good.

Weird....

 

Thanks

Helpful resources

Announcements
November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Live Sessions with Fabric DB

Be one of the first to start using Fabric Databases

Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.

Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.

Nov PBI Update Carousel

Power BI Monthly Update - November 2024

Check out the November 2024 Power BI update to learn about new features.