Forum Discussion
dgeebs
1 year agoRegular Visitor
Dataflow Gen2 Fails to refresh - '_WriteToDataDestination' - 'Data source credentials are missing..
I have a Dataflow Gen 2 (CICD) item that unexpectedly stopped refreshing successfully. The dataflow collects data from several web sources, transforms it, and loads the data into Fabric Lakehouse Ta...
- Anonymous1 year ago
Hi dgeebs ,
Disabling “Enable staging” was a good tip, but in my case, the real issue came down to broken permissions and metadata bindings after deployment pipeline promotion.
- Reapplied Lakehouse permissions manually in the Prod workspace
→ Gave my user Build + Read/Write access again - Rebound the destination table in the Prod-stage Dataflow
→ Removed and re-added the Lakehouse output - Published and refreshed the dataflow worked successfully
After using pipelines, always verify Lakehouse permissions and rebind Dataflow destinations, even if everything looks fine.
Regards,
Akhil. - Reapplied Lakehouse permissions manually in the Prod workspace
Anonymous
1 year agoNot applicable
Hi dgeebs ,
Great to hear you tracked down the root cause and got it working. Thanks for sharing the detailed steps it’ll definitely help others running into the same issue. Just curious, after reapplying the permissions and rebinding, have things stayed stable across subsequent pipeline promotions?
Regards,
Akhil.