Forum Discussion

Manasaanalytics's avatar
Manasaanalytics
Regular Visitor
2 months ago
Solved

power query editor slow loading

Hi People, 

 

    Iam working with the power query editor for huge datasize with few good power queries but its taking more time for loading rather than usual like its more than one hour, why this happens. can anyone help me with this.

 

with regards, 

Manasa 

data analyst 

  • Keyword: huge data size. Unless transformations can be folded back to the source, Power Query processes them in memory, and as data volume increases, performance becomes progressively slower. For example, when Power Query filters in-memory, it first loads the full dataset into RAM (instead of pushing the filter to the source), then applies the filter using its local M engine row by row. That means every record is evaluated inside memory. As a result, performance depends entirely on available memory and processing power, and large datasets can become slow or even fail if they exceed memory limits. Also it matters where the source is from. It generally is faster if the data is locally stored in the device instead of being sourced remotely.

5 Replies

  • Keyword: huge data size. Unless transformations can be folded back to the source, Power Query processes them in memory, and as data volume increases, performance becomes progressively slower. For example, when Power Query filters in-memory, it first loads the full dataset into RAM (instead of pushing the filter to the source), then applies the filter using its local M engine row by row. That means every record is evaluated inside memory. As a result, performance depends entirely on available memory and processing power, and large datasets can become slow or even fail if they exceed memory limits. Also it matters where the source is from. It generally is faster if the data is locally stored in the device instead of being sourced remotely.

  • v-prasare's avatar
    v-prasare
    Community Support

    HI Manasaanalytics,

    We would like to confirm if our community members answer resolves your query or if you need further help. If you still have any questions or need more support, please feel free to let us know. We are happy to help you.


    danextian & Kedar_Pande ,Thanks for your prompt response

     

     

    Thank you for your patience and look forward to hearing from you.
    Best Regards,
    Prashanth Are
    MS Fabric community support

  • v-prasare's avatar
    v-prasare
    Community Support

    HI @Manasaanalytics,

    We would like to confirm if our community members answer resolves your query or if you need further help. If you still have any questions or need more support, please feel free to let us know. We are happy to help you.

     

     

    Thank you for your patience and look forward to hearing from you.
    Best Regards,
    Prashanth Are
    MS Fabric community support