I'm running a DirectQuery to a database using 4 tables from the same database. When I try to add latitude and longitude columns from one of the tables, it adds them fine, but creates an average of the values. Then when I tell Power BI "Don't Summarize" these columns it cranks for a little while and does it, but then the memory usage climbs until all memory is used and remains there for a long time. Very often I simply have to close Power BI and wait for the memory usage to drop back down and then start over. I have experienced this with other columns and other tables in this database, every time it is the msmdsrv.exe process that is eating up the memory. (See attached screen shot.)
I think your table contains huge amount of records, right?
When you cancel summary method, power bi will expand summarized records and re-analysis and calculation formulas on them.(these operation will cost huge amount of memory if your table contains large amount records, complex measure calculation, nested loop functions)
BTW, power bi will generate analysis instance to store your data when data model generated. So 'msmdsrv.exe' will cost lot of memories when power bi calculation these process.
I thought this might be the case as well, so I limited the data to a single year using the Page Level Filter (reducing my rows of data from 600K to about 14K) and deleted all calculations. Power BI still does the same thing.