Starting December 3, join live sessions with database experts and the Microsoft product team to learn just how easy it is to get started
Learn moreGet certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now
Hello,
I have the following problem with Table.Profile() function.
Standard output is as follows:
I need to perform Table.Profile() on table that has 130 columns and around 2 milion of rows (I need to know only Count and Null Count basically for each column. The rest of statistics is not required). With that, Table.Profile() is not able to handle (timout error). Unfortunately the action needs to be done on the whole table (business requirement).
Is there any way to calculate this in PowerQuery instead of on a database directly with T-SQL?
Appreciate any tips!
Thank you for quick answer.
I did a manual work, but the problem is not solved. In order to perform transformations PowerBI needs to switch from Direct Query to Import Node so all calculations are performed locally. I did several tests but it takes too long, so can not accept it. Finally, we wrote a T-SQL procedure to calculate the KPI's
I'm reasonably sure you can write your own version.
Unpivot the columns and Add a Custom Column (if value is "" then 1 else 0)
perform a 'Group By' with 2 aggregations (Count rows and Sum of the custom column)
Let me know how you get on
Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.
User | Count |
---|---|
24 | |
12 | |
11 | |
11 | |
8 |
User | Count |
---|---|
43 | |
25 | |
16 | |
15 | |
12 |