Forum Discussion

haykp's avatar
haykp
Icon for Helper I rankHelper I
3 years ago

Importing folder takes very long

Dear Community,   Please help to understand why importing folder takes so long and how I can speed up.   I have some folder hierarchy which contains neede csv files. The csv files are located bel...
Need Help
haykp's avatar
haykp
Icon for Helper I rankHelper I
3 years ago

Thanks for the answer.

Can you please explain more about your suggestion?

Do you mean creating multiple Queryies?

Thejeswar's avatar
Thejeswar
Icon for Super User rankSuper User
3 years ago

Yes, You need to create multiple queries each referring to one folder from where you are getting the file. After doing the below steps, append the queries

 

a) filter all .csv files 

b) filter all the files which start with the given name e.g. fileName_ 

c) Append all the queries to make them into one

 

  • haykp's avatar
    haykp
    Icon for Helper I rankHelper I
    3 years ago

    Thanks for the answer.

    Acutally I am creating the same way, just each of the query takes ages. Also the a),b) steps takes too long.

    • Thejeswar's avatar
      Thejeswar
      Icon for Super User rankSuper User
      3 years ago

      haykp 

      When you split the folder path and pull the data using different queries, in a ideal case, the first 2 steps time taken should get decreased to very little. Even in that case it takes a lot of time, It should be that there are huge number of files in the location that you are trying to access. 

       

      If you don't have huge number of files in that location, I don't think it is a problem with Power BI connector. Something else is causing this issue