Forum Discussion
Could not determine JSON object type for type Microsoft.DataTransfer.DataTypes.Date.
I'm trying to use a Copy Data node to send a table to an external WebHook. The data source is a Lakehouse table that I've created using a Notebook and PySpark.
I'm getting the following error message:
ErrorCode=InvalidParameter,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The value of the property '' is invalid: 'Could not determine JSON object type for type Microsoft.DataTransfer.DataTypes.Date.'.,Source=,''Type=System.ArgumentException,Message=Could not determine JSON object type for type Microsoft.DataTransfer.DataTypes.Date.,Source=Newtonsoft.Json,'
Please check why this is happening. It's entirely blocking me right now.
10 Replies
Hi Hendrik1980 ,
Thanks for using Fabric Community.
Can you please share the screenshot of the pipeline along with activity configration?
Inorder to help you out, I need these details - what exactly are you doing here?Here's a screenshot of the pipeline.
And the Copy Data activity is configured like this:
{ "name": "Copy data1", "type": "Copy", "dependsOn": [ { "activity": "Clockify JSON to ADV CSV", "dependencyConditions": [ "Succeeded" ] } ], "policy": { "timeout": "0.12:00:00", "retry": 0, "retryIntervalInSeconds": 30, "secureOutput": false, "secureInput": false }, "typeProperties": { "source": { "type": "LakehouseTableSource", "datasetSettings": { "annotations": [], "linkedService": { "name": "Clockify", "properties": { "annotations": [], "type": "Lakehouse", "typeProperties": { "workspaceId": "f81cf571-7587-428c-a68d-25b3177c337b", "artifactId": "ee28671f-e7db-4649-a545-ea868e2af123", "rootFolder": "Tables" } } }, "type": "LakehouseTable", "schema": [], "typeProperties": { "table": "adv_output" } } }, "sink": { "type": "RestSink", "httpRequestTimeout": "00:05:00", "requestInterval": 10, "requestMethod": "PUT", "writeBatchSize": 10000, "httpCompressionType": "none", "datasetSettings": { "annotations": [], "type": "RestResource", "typeProperties": { "relativeUrl": "webhook-test/fabric-clockify-adv" }, "schema": [], "externalReferences": { "connection": "01fb0275-f785-4223-93fa-02f3eb148cff" } } }, "enableStaging": false, "translator": { "type": "TabularTranslator", "typeConversion": true, "typeConversionSettings": { "allowDataTruncation": true, "treatBooleanAsNumber": false } } } }Hi Hendrik1980 ,
The error message you're encountering,ErrorCode=InvalidParameter, indicates that there's an issue with the way a date value is being formatted in your JSON data. It seems Microsoft Data Factory is expecting a specific format for dates, but the data you're providing doesn't match that format.
Please check with date values, you should be able to get some resolution.The values in the date column are just that: dates. Timestamps. Some kind of representation of a date. Whatever format is required, under the hood it should be nothing other than a timestamp. If it was a string column, I could understand the format argument. But the date column has no "format" other than what's displayed to the user. It has some date time information, timezone naive or timezone aware. How that date is made readable, should be irrelevant for the JSON conversion. I would expect the JSON conversion, which essentially converts the date time object into a string (yes), to use some universal or configurable format instead of just failing. I see no option to choose a format for the date to JSON conversion anywhere. It just fails. As a bare minimum/default/fallback format I would expect the datetime to be redered into an ISO string - instead of failing.
