The ultimate Fabric, Power BI, SQL, and AI community-led learning event. Save €200 with code FABCOMM.
Get registeredEnhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.
Hi everyone,
I have recently adjusted one of my reports - one of our customers stopped sending us EAN for old products. I adjusted the queries and now it searches by name of the product in one of our old file. In theory this should work, but when I refresh, the report just keeps loading more and more rows. I expect around 2,5 mil rows, but the last refresh loaded 130+ mil rows.
My guess was I have made circular reference, but i dont see anything in the relationships. Can you please advice?
CustomerRole (Customer) | Customers (Customer) |
dmStock (CustEAN) | Listing (CustEAN) |
dmStock (Customer) | Customers (Customer) |
dmStock (EAN) | EAN Cat (EAN) |
dmStock (Period) | Calendar (Date) |
KrajcikStock (Customer) | Customers (Customer) |
KrajcikStock (EAN) | EAN Cat (EAN) |
KrajcikStock (Month) | Calendar (Date) |
ParaTab (Code) | Period Selection (Code) |
PKS_Stock (Customer) | Customers (Customer) |
PKS_Stock (EAN) | EAN Cat (EAN) |
soPksMskReeds (Customer) | Customers (Customer) |
SO Val W (CustEAN) | C Products (CustEAN) |
SO Val W (CustEAN) | Listing (CustEAN) |
SO Val W (Customer) | Customers (Customer) |
SO Val W (EAN) | EAN Cat (EAN) |
SO Val W (EAN) | Producers (EAN) |
SO Val W (StoreFormat) | StoreFormat (StoreFormatCode) |
SO Val W (Week) | Calendar (Date) |
Listing (Customers) | Customers (Customer) |
Producers (EAN) | EAN Cat (EAN) |
Thanks in advance
Filip
Hi @louzensf
Based on the details you provided, it sounds like a tweak to searching by product name caused unexpected behavior during data loading. While circular references can certainly cause such problems, the problem could also lie elsewhere, as you mentioned that any circular references in the relationship are not recognized.
Please try the following ways to resolve the issue:
Go back to the modified query and make sure the logic is correct. Sometimes, inadvertently including or not being specific enough filters can result in a data set that is much larger than expected.
Verify that the relationships between tables are set up correctly. Incorrect relationships (for example, a many-to-many relationship where one-to-many is expected) may cause more rows to be loaded.
Review each step applied to the query in Power Query and make sure no steps inadvertently duplicate rows or otherwise extend the data set.
Consider whether the data model can be optimized to prevent performance issues. This may include summarizing data, creating indexes, or pre-aggregating values.
Make sure any report-level filters or slicers are applied correctly and don't inadvertently cause problems.
This can also be a factor if the data source has limitations in how it handles queries, especially when searching by product name. Make sure the data source is optimized for the type of query you are running.
Use the Performance Analyzer in Power BI Desktop to see which parts of the report are taking the longest to load. This helps pinpoint where the problem may be occurring.
You can view the link below for more details:
Understand star schema and the importance for Power BI - Power BI | Microsoft Learn
Regards,
Nono Chen
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi @Kishore_KVN , thanks for answering,
I have used merge to fill in some '?' we are getting instead of EANs, with the use of one of our old files. Now the refresh loads way more data than it should and from 9 minute refresh I got to 2hr+ and it still didn't finish.
I figured that maybe this is a problem with merge function? I can simply Xlookup the ? in the excel, but I need the reports to be as automatic as possble.
Thanks!