Forum Discussion
Slow CSV import
Hi mwegener and v-easonf-msft,
It turns out that it was a rookie mistake. I was processing my data during the import process which was causing the import to be ridiculously slow. I've since imported the CSVs as is and am applying the calculations to the imported data, which has reduced the import process from 90 minutes to < 10 seconds!
Lesson learned, now just to figure out how to get my formulas to work again (since I now have combined data in one table instead of individual tables).
Thanks for the feedback, though!
Hi mwegener and v-easonf-msft,
It turns out that it was a rookie mistake. I was processing my data during the import process which was causing the import to be ridiculously slow. I've since imported the CSVs as is and am applying the calculations to the imported data, which has reduced the import process from 90 minutes to < 10 seconds!
Lesson learned, now just to figure out how to get my formulas to work again (since I now have combined data in one table instead of individual tables).
Thanks for the feedback, though!
andygoes, are you conducting the calculations/transformations in a separate query which references your combined table query or are you doing the calculations in DAX once the source table has been imported? It would be helpful If you could share your new process.
- H