Improving the error message when a data type conversion issue occurs writing onto a lakehouse
Hi,
for an evenstream that reads from an Azure Event Hubs to write the events onto a lakehouse I've encountered a data type conversion error and looking to the Run-time logs I've seen a such generic error message:
{
"ErrorCode": {
"value": "Warning",
"type": "string"
},
"TimeGenerated": {
"value": "2024-10-14 13:39:48Z",
"type": "datetime"
},
"Level": {
"value": "Warning",
"type": "string"
},
"Category": {
"value": "Warning",
"type": "string"
},
"ResourceId": {
"value": "",
"type": "string"
},
"SubscriptionId": {
"value": "",
"type": "string"
},
"ResourceGroup": {
"value": "",
"type": "string"
},
"JobName": {
"value": "",
"type": "string"
},
"OperationName": {
"value": "",
"type": "string"
},
"Status": {
"value": "Warning",
"type": "string"
},
"Source": {
"value": "",
"type": "string"
},
"TypeProperty": {
"value": "Warning",
"type": "string"
},
"DataErrorType": {
"value": "",
"type": "string"
},
"ErrorCategory": {
"value": "Warning",
"type": "string"
},
"BriefMessage": {
"value": "",
"type": "string"
},
"Message": {
"value": "First Occurred: 10/14/2024 1:39:46 PM UTC | Resource Name: 234dbbd1-4cb0-ab3b-7e66-a02a98fe0732 | Message: Source '234dbbd1-4cb0-ab3b-7e66-a02a98fe0732' had 1 occurrences of kind 'OutputDataConversionError.TypeConversionError' between processing times '2024-10-14T13:39:46.5109807Z' and '2024-10-14T13:39:46.7587399Z'. \r\n",
"type": "string"
},
"FromTimestamp": {
"value": null,
"type": "datetime"
},
"ToTimestamp": {
"value": null,
"type": "datetime"
},
"EventCount": {
"value": 0,
"type": "long"
},
"GroupSize": {
"value": 1,
"type": "long"
}
}
It could be very useful to have a major detail in order to detect the specific event data that causes the issue. Thanks
1 Comment
- fbcideas_migusrNew MemberStatus added:New
Recent ideas
Deployment Pipelines - Remember selected stage
Every time we go into a deployment pipeline, it defaults to selecting the Development stage. I believe that it would be very rare to have a user select the Development stage. It would be helpful if d...PeterDaniels4 hours agoAdvocate IINew1View0likes0CommentsDisable auto-restore previous session's tabs in new Fabric sessions
Description: Since a recent update, starting a new Fabric session — for example by opening Fabric in a new browser tab — automatically reopens all the item tabs that were left open from a previous s...MathieuVr11 hours agoFrequent VisitorNew56Views5likes1CommentExported PDF from PowerBI to not have any indents/borders
Currently, using the "Export to PDF" option in PowerBI results in two consistently buggy results: A white border/indent is generated, increasing the size of the page from 8.5x11 to 9x11.5 Sometime...EliShalev14 hours agoNew MemberNew12Views0likes0CommentsAdding a Container for Logical Grouping of Activities in Data Pipelines
Dear Team, I would like to propose a feature enhancement for Data Pipelines in Microsoft Fabric that allows the logical grouping of activities into a container. This container would serve to: Im...lukas_karlovsky15 hours agoNew MemberPlanned876Views15likes5Comments