Forum Discussion
Resolver IHow to Optimize Memory Usage?
Resolver IThe issue has been solved! It was a problem with the query steps where two queries were merged together based on text columns. In large datasets I think it required too much memory to perform the table scan necessary to complete the full outer join. I switched it to match based on a whole number and it still takes a little bit of time, but the RAM is much more reasonable and the computer does not become unresponsive.
Responsive ResidentHi rlansing, Another tip that you might follow is to check your data types in the Data Model. I've noticed that a stray number that appears as Text in Data Model, consumes a lot more memory than it should. Moreover, it is worth considering making your "joins" in the data model. Or rather try to migrate some of this work into there.
Also on the query side. Some of the functions have the ability to "stream" data. I know at least one binary function that does that :) BinaryFormat.Choice