Forum Discussion
Avoid direct query by dumping data to CSV?
- 5 years ago
Anonymous you cannot do DQ to CSV, only Import. How big is a dataset that needs to be DQ? There are many factors when it comes to these kinds of modeling discussion. If it needs to be DQ then most of the time you want data to be prepared/cleaned/transformed at source since there is a limited transformation you can do in PQ. Again this is not one size fits all, a lot of items go into the discussion when you go between DQ/Import and Mixed mode.
Anonymous you cannot do DQ to CSV, only Import. How big is a dataset that needs to be DQ? There are many factors when it comes to these kinds of modeling discussion. If it needs to be DQ then most of the time you want data to be prepared/cleaned/transformed at source since there is a limited transformation you can do in PQ. Again this is not one size fits all, a lot of items go into the discussion when you go between DQ/Import and Mixed mode.