Forum Discussion
Dataflow in pipeline succeeds but does nothing
- 1 year ago
I figured out what the issue was: it's the general unclear behavior with Dataflows with closing vs publishing.
When you exit out of the Dataflow editor, you think it's saving your latest changes because when you go back you will see the most recent state. But in fact it saved the previous state, and you can't save a Dataflow without running it.
This means that if you are doing a fetch+append data on a weekly or monthly basis, which is what I am doing, you have to wait until the last day of your time window to publish your Dataflow, and only then can you enable the auto-run schedule.
Hi DCELL ,
We wanted to kindly follow up to check if the solution provided for the issue worked? or Let us know if you need any further assistance?
If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.
|
Please don't forget to give a "Kudos " – I’d truly appreciate it! |
Regards,
B Manikanteswara Reddy
Hi DCELL ,
As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for the issue worked? or Let us know if you need any further assistance?
If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.
|
Please don't forget to give a "Kudos " – I’d truly appreciate it! |
Regards,
B Manikanteswara Reddy
- DCELL1 year ago
Resolver I
Hello, I've gone through the list and the issue must have been something else.
-The data was already ready
-The dataflow configuration is correct; when running the dataflow without the pipeline it worked. Only when that exact same dataflow is in a pipeline does it 'succeed' but without any effect
-Credentials - but wouldn't the dataflow in the pipeline simply fail in this case if the credentials aren't up to date?
-Schema is correct. The dataflow works outside of a pipeline, but not when inside a pipeline