Forum Discussion

nathan-verghis's avatar
nathan-verghis
Regular Visitor
1 year ago
Solved

Dataflow refresh job failed: Job instance failed without detail error

Hello,   I've been building a series of Dataflows to transform and load data between our Bronze and Silver Lakehouses across a couple different data providers. In my architecture, we have 1 dataflo...
Dataflow
Need Help
  • v-veshwara-msft's avatar
    v-veshwara-msft
    1 year ago

    Hi nathan-verghis ,
    Thanks for the follow-up.

    Since the issue persists even after trying the available workarounds and there's no clear indicator from the Dataflow logs, the best next step would be to raise a support ticket with Microsoft for deeper investigation. If you've already raised a support request, please consider sharing any insights or resolutions provided by the support team here, it would be helpful for others facing the same issue.

    Also thanks to miguel and Ilgar_Zarbali for addressing this and sharing your valuable insights.

     

    Best Regards,
    Vinay,
    Community Support Team.

     

nathan-verghis's avatar
nathan-verghis
Regular Visitor
1 year ago

Unfortunately this is still an issue. I've attempted the solutions posted so far, however haven't had any success. So far just manually running the dataflow seems to work better than it being triggered by the pipeline on a schedule, but I don't see why that should cause any issues. For insight, this error tends to occur about a minute into the dataflow run, but I don't see any schema changes that would cause the issue (especially since this is only happening between Bronze and Silver, not the initial load into Bronze)

miguel's avatar
miguel
Community Admin
1 year ago

Hi!

My name is Miguel Escobar and I'm a product manager for Dataflow Gen2. Will be happy to help you reach a solution.

 

Could you please share some more information?

  • Are you using a Dataflow Gen2 or is it a Dataflow Gen2 with CI/CD support?
  • Could you please share exactly where you're seeing the 20302 error? is it within the Data pipelines? if it is within the pipelines, could you please head over to the Workspace list, select the acitons menu of the Dataflwo that failed the refresh, select the option with the label "recent runs", find the run that failed and see what errors are shown within that detailed report of the failed refresh? if you could provide a screenshot of the error from the recent runs that would help tremendously

If you have a support ticket, you can also share it with me via a private direct message and we can follow up through that secure support channel.