Forum Discussion

gshapiev's avatar
gshapiev
Frequent Visitor
10 months ago
Solved

REST API. jobs/instances?jobType=Refresh causes error while manual refresh works

Trying to refresh Dataflow Gen2 (CI/CD) dataflow using Rest API   Getting error on the service side: There was a problem refreshing the dataflow: 'Exception encountered in GetPublishStatusAsync: R...
Dataflow
  • gshapiev's avatar
    gshapiev
    10 months ago

    The problem was with permissions. Was trying to refresh with service principal which is not supported at the moment

     

Anonymous's avatar
Anonymous
Not applicable
10 months ago

Hi gshapiev,

 

When you sync changes from Git into the workspace or use deployment pipelines, you need to open the new or updated dataflow and save changes manually with the editor. This triggers a publish action in the background to allow the changes to be used during refresh of your dataflow. You can also use the on-demand Dataflow publish job API call to automate the publish operation and then refresh.

 

document where limitation is noted : https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-cicd-and-git-integration

 

Publish Job API Endpoint : POST https://api.fabric.microsoft.com/v1/workspaces/{workspaceId}/dataflows/{dataflowId}/jobs/instances?jobType=Publish

 

Thanks & Regards,

Prasanna Kumar

 

gshapiev's avatar
gshapiev
Frequent Visitor
10 months ago

1. Publish method doesn't exist anymore:

{
    "requestId": "cfb9aff5-00fa-4d4a-90d6-7e2a4e14f40c",
    "errorCode": "InvalidJobType",
    "message": "The requested job type is invalid"
}
 
2. It is replaced with ApplyChanges. When calling it getting error in responce. Not very informative:
{
    "id": "7f6ca2fb-5dda-4c64-bc1d-ada29e2dd093",
    "itemId": "15cacd88-df9d-447a-9caa-b17cdb87af6d",
    "jobType": "Publish",
    "invokeType": "Manual",
    "status": "Failed",
    "failureReason": {
        "requestId": "b5155ec5-6584-4580-a337-5c80b4f6868a",
        "errorCode": "JobInstanceStatusFailed",
        "message": "Job instance failed without detail error"
    },
    "rootActivityId": "36db2346-20a5-4b89-95bc-d2b44021b06b",
    "startTimeUtc": "2025-09-23T13:21:50.9036366",
    "endTimeUtc": "2025-09-23T13:21:50.9036366"
}
 
3. I tried to publishing it manually. Error in the topic starter is happening after that. Can refresh manually bit with refreshing through api getting similar message and that error on the service side
 
Thank you