Hi,
I have been working today with pipelines and Jibble API , this seems to be working find and pagination sorted etc. Challenge is if I use any of the parameters e.g. $orderby=time asc or $filter=(belongsToDate gt 2024-09-01) then it fails, this seems to be the commonality as all of the other parameters work and when testing in a Dataflow or other it's fine. It seems to be to do with the Relative URL and including query parameters with spaces in the data.
If this is a bug then, do we have a workaround? If it is something that I am doing incorrectly then it would be great to know what. I have also tried encoding (%20) or even double encoding (%2520) which does not work.
Object Definition:
{
"name": "Timesheets",
"type": "Copy",
"dependsOn": [
{
"activity": "JibbleAuth",
"dependencyConditions": [
"Succeeded"
]
}
],
"policy": {
"timeout": "0.12:00:00",
"retry": 0,
"retryIntervalInSeconds": 30,
"secureOutput": false,
"secureInput": false
},
"typeProperties": {
"source": {
"type": "RestSource",
"httpRequestTimeout": "00:01:40",
"requestInterval": "00.00:00:00.010",
"requestMethod": "GET",
"additionalHeaders": {
"Authorization": {
"value": "@concat('bearer ', activity('JibbleAuth').output.access_token)",
"type": "Expression"
}
},
"paginationRules": {
"AbsoluteUrl.{offset}": {
"value": "@concat('RANGE:0::', variables('pageSize'))",
"type": "Expression"
},
"EndCondition:$.value": "Empty"
},
"datasetSettings": {
"annotations": [],
"type": "RestResource",
"typeProperties": {
"relativeUrl": {
"value": "@concat('TimeEntries?'\n ,'$count=true'\n ,'&$expand=person'\n ,'&$filter=(belongsToDate%20gt%202024-09-01)'\n ,'&$orderby=time%20asc'\n ,'&$skip={offset}'\n ,'&$top=',variables('pageSize')\n)",
"type": "Expression"
}
},
"schema": [],
"externalReferences": {
"connection": "ed35e6ab-65d4-4d47-b33f-c5f5c80759a0"
}
}
},
"sink": {
"type": "JsonSink",
"storeSettings": {
"type": "LakehouseWriteSettings",
"copyBehavior": "MergeFiles"
},
"formatSettings": {
"type": "JsonWriteSettings",
"filePattern": "arrayOfObjects"
},
"datasetSettings": {
"annotations": [],
"linkedService": {
"name": "DataflowsStagingLakehouse",
"properties": {
"annotations": [],
"type": "Lakehouse",
"typeProperties": {
"workspaceId": "0b2657ad-02da-4a9a-80e0-d2d338a094b4",
"artifactId": "b778af8e-4712-449e-ada3-26434b8ed42a",
"rootFolder": "Files"
}
}
},
"type": "Json",
"typeProperties": {
"location": {
"type": "LakehouseLocation",
"fileName": "timesheeets.json",
"folderPath": "JibbleFiles"
}
},
"schema": {}
}
},
"enableStaging": false,
"parallelCopies": 1,
"dataIntegrationUnits": 64
}
}
Error Message:
Rest call failed with server error, status code 500 InternalServerError, please check your activity settings and remote server issues.
Request URL: https://time-tracking.prod.jibble.io/v1/TimeEntries?$count=true&$expand=person&$filter=(belongsToDat....
Response: {"error":{"code":"202409121855093b8f38731446d07849","message":"Something went wrong"}}
