Forum Discussion

mariussve1's avatar
mariussve1
Icon for Solution Sage rankSolution Sage
2 years ago

Data pipeline - From API to Oracle onprem with Gateway - Issues - Stucked in status "Queued"

Hi everyone,


I'm having issue writing back to a Oracle Onprem with Gateway.

My usecase is to trigger some refreshes in Power BI with api, and write status back on Oracle onprem data warehouse. This is up and running in Power Automate, but I now want to migrate all of this jobs into Data pipelines instead.


I can read from Oracle, but when I'm using copy activity to write from api back to oracel onprem its stucked in "Queued".

 



Here is the JSON for pipeline:

 

 

{
    "name": "Write to Oracle",
    "objectId": "<objectId>",
    "properties": {
        "activities": [
            {
                "name": "Copy data1",
                "type": "Copy",
                "dependsOn": [],
                "policy": {
                    "timeout": "0.12:00:00",
                    "retry": 0,
                    "retryIntervalInSeconds": 30,
                    "secureOutput": false,
                    "secureInput": false
                },
                "typeProperties": {
                    "source": {
                        "type": "RestSource",
                        "httpRequestTimeout": "00:01:40",
                        "requestInterval": "00.00:00:00.010",
                        "requestMethod": "GET",
                        "paginationRules": {
                            "supportRFC5988": "true"
                        },
                        "datasetSettings": {
                            "annotations": [],
                            "type": "RestResource",
                            "typeProperties": {
                                "relativeUrl": "groups/<groupid>/datasets/<datasetid>/refreshes?$top=1"
                            },
                            "schema": [],
                            "externalReferences": {
                                "connection": "<connectionid>"
                            }
                        }
                    },
                    "sink": {
                        "type": "OracleSink",
                        "writeBatchSize": 10000,
                        "datasetSettings": {
                            "annotations": [],
                            "type": "OracleTable",
                            "schema": [],
                            "typeProperties": {
                                "schema": "<schemaname>",
                                "table": "PBI_REFRESH_LOG_MSV"
                            },
                            "externalReferences": {
                                "connection": "<connectionid>"
                            }
                        }
                    },
                    "enableStaging": false,
                    "translator": {
                        "type": "TabularTranslator",
                        "mappings": [
                            {
                                "source": {
                                    "name": "value.requestId",
                                    "type": "String"
                                },
                                "sink": {
                                    "name": "REQUESTID",
                                    "type": "String"
                                }
                            },
                            {
                                "source": {
                                    "name": "value.id",
                                    "type": "Int64"
                                },
                                "sink": {
                                    "name": "ID",
                                    "type": "String"
                                }
                            },
                            {
                                "source": {
                                    "name": "value.refreshType",
                                    "type": "String"
                                },
                                "sink": {
                                    "name": "REFRESHTYPE",
                                    "type": "String"
                                }
                            },
                            {
                                "source": {
                                    "name": "value.startTime",
                                    "type": "String"
                                },
                                "sink": {
                                    "name": "STARTTIME",
                                    "type": "String"
                                }
                            },
                            {
                                "source": {
                                    "name": "value.endTime",
                                    "type": "String"
                                },
                                "sink": {
                                    "name": "ENDTIME",
                                    "type": "String"
                                }
                            },
                            {
                                "source": {
                                    "name": "value.status",
                                    "type": "String"
                                },
                                "sink": {
                                    "name": "STATUS",
                                    "type": "String"
                                }
                            },
                            {
                                "source": {
                                    "name": "value.extendedStatus",
                                    "type": "String"
                                },
                                "sink": {
                                    "name": "EXTENDEDSTATUS",
                                    "type": "String"
                                }
                            }
                        ],
                        "typeConversion": true,
                        "typeConversionSettings": {
                            "allowDataTruncation": true,
                            "treatBooleanAsNumber": false
                        },
                        "columnFlattenSettings": {
                            "treatArrayAsString": false,
                            "treatStructAsString": false,
                            "flattenColumnDelimiter": "."
                        }
                    }
                }
            }
        ],
        "lastModifiedByObjectId": "<objectid>",
        "lastPublishTime": "2024-07-01T13:51:38Z"
    }

 

 

 

I really appreciate all the help, as I have struggled with this for several days.

 

Br
Marius 🙂

4 Replies

    • mariussve1's avatar
      mariussve1
      Icon for Solution Sage rankSolution Sage

      Hi Anonymous and thank you for the answer 🙂

      Even if the connector is in preview, it should work? Or am I missing something here?


      Marius

  • Is there anyone got this working? Write back to an oracle database with power bi premium gateway 🙂

     

    Br

    Marius

  • Hi,

     

    Last hope someone has done this and can tell me how 🙂

     

    Marius