Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago

Table.Profile applied to each Table .Group (GroupKind,.Local & SQL set ordered): too much RAM

Hi,   Here is my pseudo M query code:   Source = select * from ms sql-server table ordered by indexed id  #GroupedRows = Table.Group(Source, 3 columns (one of which is the indexed id & the other...
Need Help
lbendlin's avatar
lbendlin
Icon for Super User rankSuper User
4 years ago

What is the actual question you are trying to answer? Some sort of a correlation analysis?

 

650 columns will be slow in any scenario. Can you please explain what your grouping criteria are, or maybe give an example?

Anonymous's avatar
Anonymous
Not applicable
4 years ago

lbendlin i should also say that initially i had split up all the groupings manually as separate queries & the profile took about 1.5hrs. i turned off parallel & background previews. not sure if that helps. thanks. i am trying to make it dynamic though as the groupings will change frequently. 

  • lbendlin's avatar
    lbendlin
    Icon for Super User rankSuper User
    4 years ago

    Frankly I wouldn't bother with Power Query for that.  There are tools like Alteryx or Knime that are more specialized and (in the case of Alteryx) have far better performance.

     

    Anyway - would you be able to  provide a sample extract that can demonstrate the issue?