Forum Discussion

spider_Monkey's avatar
spider_Monkey
Helper I
3 years ago

Automatically Split One Table into Smaller Tables based on a row value (Name)

Hello, 

 

I am working with a dataset with 15mm+ rows, so needless to say I am running into issues while writing some formulas. I have found if I make the data set smaller the formulas work. 

 

So what I am trying to figure out is if there is a way to automatically split a table into smaller tables based on the name column from the table below. Basically I want to get this information into 4 seperate tables automatically as it refreshes daily. 

 

NameDateStateEventCompany
Charles G1/1/2022 CallABC 
Dave1/1/2022 TextXYZ
Steve S1/1/2022 EmailEnron
Katie1/1/2022 EmailLife
Charles G1/1/2022 CallABC 
Dave1/1/2022 CallXYZ
Charles G1/1/2022 TextABC 
Dave1/1/2022 EmailXYZ
Charles G1/3/2022 EmailABC 
Charles G1/3/2022 CallABC 
Charles G1/1/2022 CallABC 
Katie1/2/2022 TextLife
Katie1/2/2022 EmailLife
Katie1/1/2022 EmailLife
Dave1/1/2022 CallXYZ
Dave1/1/2022 CallXYZ

 

General Comment

8 Replies

  • FataiSanni's avatar
    FataiSanni
    Advocate III
    3 years ago

    Hi,

     

    You can create 4 different queries with each having its own 'name' filter, so for instance Query 1 is filtered to 'Dave' alone, and you can do this for other queries as well.

     

    Alternatively, you can reduce the amount of data you work with in the Power BI desktop that won't affect performance then expand the data to the full scope when you publish to the service. This way, you won't need to split the tables. You can see how this works here.

     

    If this post helps, then please consider Accepting it as the solution to help the other members find it more quickly

  • spider_Monkey's avatar
    spider_Monkey
    Helper I
    3 years ago

    So the problem is I am dealing with 150+ names so I can't manully do the queries. 

  • ppm1's avatar
    ppm1
    Solution Sage
    3 years ago

    While it is likely possible to do what you are asking, you probably shouldn't. Instead, please share the measures you have tried that are not performant and/or further describe your data model. 15M rows is not that much for Power BI but it is not hard to get poor performance if your DAX doesn't follow best practices.

     

    Pat

    • spider_Monkey's avatar
      spider_Monkey
      Helper I
      3 years ago

      Hey Pat,

       

      Below is the formula, currently it's just on the table, I was wondering if I did it at the query level that would help.  If it helps when I limit the table to about 16-20k rows the formula works no problem. 

       

      Data set is about 15mm rows and 26 columns. 

       

      Previous Action = CALCULATE(MAX('Test'[Date]),
      (Filter('Test',EARLIER('Test'[ID])='Test'[ID] &&
      EARLIER('Test'[Date])>'Test'[Date])

      • spider_Monkey's avatar
        spider_Monkey
        Helper I
        3 years ago

        Do you know of a way to write that formula to make a custom column in the query?