Forum Discussion
Dataflow gen2 refresh Error
I'm not sure sure that we can help with the information shared on this thread. Do you have a way for us to repro the behavior or could you go into details as to how we could create something similar in our own environments ? Or perhaps a more detailed definition of your mashup document ?
assuming that you're using the latest version of the gateway, please raise a support ticket so our engineering team can take a closer look at this scenario
To reproduce
#1. Ingest a data from on prem sql server to a lakehouse with fixed schema and replace using a df gen2. Do not factor in incremental refresh.
There is no issue in this step.
#2. Go back and factor in incremental refresh in the same df gen2 and run the dataflow. It errors out in this stage with 10855.
#3. If you factor in incremental refresh in #1 before doing a base ingestion, it gets error out with tge same error.
What I desire is to be able to ingest from on prem sql server db to lakehouse with incremental baked in without any error.