Forum Discussion
Helper IDataFlow Gen 2 Error:Fast copy user error
Totally understand that there were no settings at the query level, but would you mind checking if the Fast Copy setting at the Dataflow level was enabled?
You can see this inside the Options > Dataflow > Scale tab
You can turn this setting off and your Dataflow will not try to use Fast Copy unless you explicitly use the setting at the query level.
Complex values like [Table] values can create some situations that would prevent Fast Copy to behave the way its intended. It also happens with how Staging that table would yield the same column but with null values as you cannot store "Table" (complex values) into a staging table.
Helper IHi,
1) Didnt have Fast Copy enabled for any
2) No, only [Table] values, as far as I understood
Community AdminTotally understand that there were no settings at the query level, but would you mind checking if the Fast Copy setting at the Dataflow level was enabled?
You can see this inside the Options > Dataflow > Scale tab
You can turn this setting off and your Dataflow will not try to use Fast Copy unless you explicitly use the setting at the query level.
Complex values like [Table] values can create some situations that would prevent Fast Copy to behave the way its intended. It also happens with how Staging that table would yield the same column but with null values as you cannot store "Table" (complex values) into a staging table.
- PolinaOr
Yeah, in the settings the "Allow use of Fast Copy" was allowed. Will turn it off. Should i turn the Staging back on in this case? As I understood, this allows for faster loading of data. Our database is over 10mln lines in each table.
Essentially the Query was creating mismatched results because of this setting?
- miguel
It's difficult to provide any concrete guidance as I'm not familiar with your scenario or the details of it. We couldn't blame Fast Copy or Staging either.
Fast Copy and staging combined can definitely help you move things quicker into a Dataflow and perhaps utilize an ELT pattern where you can subsequently reference thar query and do your transformations against it.
I'd recommend creating a new thread that is more broad and talks about your scenario in detail so its more about the architectural decision rather than an issue raised by Fast Copy. Even suggesting something on just the decision of Fast Copy and Staging would be too limiting or too scoped and would definitely recommend looking at the whole scenario in detail so the most optimal architectural decision can be reached.
- PolinaOr
Thank you very much!