Getting data

[alikhalilov]

Hi, 

I just wonder that whether geting data with folder is faster or getting all file seperately and append them? 

Please  give me some advice 

Thanks lot

[selimovd · Accepted solution]

Hey @alikhalilov ,

from my experience, that shouldn't differ much. Expensive is usually the reading of the CSV files.

If you read the directory first and then loop over the files or if you add all the files individually doesn't really make a big difference.

If you have a little time you can do both in 2 separate files and then compare them.

Maybe I should test that and write an article about that 🤔

If you need any help please let me know.

If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍

Best regards

Denis

Blog: WhatTheFact.bi

Follow me: twitter.com/DenSelimovic

[Anonymous · Accepted solution]

@alikhalilov 

The processing speed does not differ much, I would still recommend  you use the folder connector for convenience purpose.

Paul Zheng _ Community Support Team

[selimovd · Accepted solution]

Hey @alikhalilov ,

from my experience, that shouldn't differ much. Expensive is usually the reading of the CSV files.

If you read the directory first and then loop over the files or if you add all the files individually doesn't really make a big difference.

If you have a little time you can do both in 2 separate files and then compare them.

Maybe I should test that and write an article about that 🤔

If you need any help please let me know.

If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍

Best regards

Denis

Blog: WhatTheFact.bi

Follow me: twitter.com/DenSelimovic