March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early bird discount ends December 31.
Register NowBe one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now
Hello,
I have a large SQL server database that consists of 60 million rows that I have imported using DirectQuery. This table contains duplicate records in one specific column that I would like to hide from a table view in my report. This large 'Detail' table is connected to a smaller 'Header' table with a many to one relationship using an ID field.
In my report I would like to add a feature that lets the user select a bar from a bar chart with 'Header' table data which would filter a subset of the 'Detail' table. This subset of data will be shown as a table in my report. This works fine except that one column has duplicates which I would like to filter. In the below scenario I would like to filter the third and fourth row that has a duplicate ID and Task combination. I am importing the data using DirectQuery so I cannot remove duplicates using the Query Editor.
Any help is greatly appreciated!
ID Task Duration
386714 | start | 0 |
386714 | write_invoice | 15 |
386714 | write_invoice | 15 |
386714 | write_invoice | 15 |
Solved! Go to Solution.
Hi @Anonymous ,
Have you tried filtering the duplicates in direct query. Ideally you should use a View which will remove duplicate records and use that as DirectQuery for your loading.
Cheers
CheenuSing
Hi @Anonymous ,
You can refer to the same case for reference: https://community.powerbi.com/t5/Desktop/Remove-duplicates-in-direct-query/td-p/238430
Best regards,
Dina Ye
Hi @Anonymous ,
Have you tried filtering the duplicates in direct query. Ideally you should use a View which will remove duplicate records and use that as DirectQuery for your loading.
Cheers
CheenuSing
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
Your insights matter. That’s why we created a quick survey to learn about your experience finding answers to technical questions.
Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.
User | Count |
---|---|
123 | |
85 | |
85 | |
70 | |
51 |
User | Count |
---|---|
205 | |
153 | |
97 | |
79 | |
69 |