Forum Discussion
Using Parameter to define if a table is loaded or not
Hi, I have a large data set that I have chunked up into separate Dataflows of Current, Archive #1, Archive #2 and when developing and testing I only want to load the Current Dataflow The cod...
Hi, I tried disabling the parellel loading but no improvement.
The data sets are hundreds of csv files so I can't move the files for testing.
So it a bug in the evaluation process then?
Cheers
Andrew
lbendlin
Super User
Super User"The data sets are hundreds of csv files so I can't move the files for testing."
Why not?
Two reasons really,
- The size they about a GB each and its never a good idea to mess with the source data
- We have other models and users that mine this data so in effect taking it off line so we can test and dev models would be complicated and disruptive.
- lbendlin
1. file size is irrelevant if the move is within the same folder structure. All you do is change pointers.
2. Would it be an option for you to have your own copy of the source data?