Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

Removing columns slowing refresh (.csv source)

Have a CSV source file pulling in just 15000 rows but over 1000 columns.  I only need a few of these so of course I remove most of them in Power Query.  Problem is it can't seem to deal with removing...
Need Help
  • v-robertq-msft's avatar
    v-robertq-msft
    5 years ago

    Hi, Anonymous 

    According to your description, you have a CSV file that has 15000 rows and over 1000 columns. I think it should be a huge amount of data for import mode. If you try to remove hundreds of columns in the Power query, it does take a lot of time because the transformation is operated on each column you removed. You can try to make another CSV file with the filtered files or just try the Table.Buffer() function as you said.

    More info about Table.RemoveColumns() function in M language

     

    Best Regards,

    Community Support Team _Robert Qin

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

v-robertq-msft's avatar
v-robertq-msft
Icon for Community Support rankCommunity Support
5 years ago

Hi, Anonymous 

According to your description, you have a CSV file that has 15000 rows and over 1000 columns. I think it should be a huge amount of data for import mode. If you try to remove hundreds of columns in the Power query, it does take a lot of time because the transformation is operated on each column you removed. You can try to make another CSV file with the filtered files or just try the Table.Buffer() function as you said.

More info about Table.RemoveColumns() function in M language

 

Best Regards,

Community Support Team _Robert Qin

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.