Forum Discussion
Which one is faster ? Function or a big data frame
In general, which one is a faster? My co worker says applying a function to various binary files is faster, while another prefers to stick with the combining the binary files into one BIG file and applying transformations.
1) Applying a function to various binary files
or
2) Appending binary files into one file first - THEN applying the tranformations.
Any help would be appreicated.
I think it would depend on the transformations being performed, so you may just have to test it to know for sure. In any case, a good practice is to do the minimal amount in the function/example file, get the data ready to append with the tables from the other files, append them, and then do further transformations.
Regards,
Pat
1 Reply
I think it would depend on the transformations being performed, so you may just have to test it to know for sure. In any case, a good practice is to do the minimal amount in the function/example file, get the data ready to append with the tables from the other files, append them, and then do further transformations.
Regards,
Pat