Postgres CDC numeric as Bigdecimal binary

[sschuetz]

Hi 

When using Postgres CDC in the realtimehub, all numeric values are loaded as bigdecimal binary.

these are hard to convert.

debezium supports a setting to change this, can this be done somehow with fabric?

[Anonymous]

Hi @sschuetz ,

As a workaround, consider implementing a data transformation step within your data pipeline. This can be done by using Azure Data Factory or a similar service to transform values into a more desirable format before or after the CDC process.

For more details, please refer:  Ingest data into your Warehouse using data pipelines - Microsoft Fabric | Microsoft Learn

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

[sschuetz]

Hi Neeko

We wanted to use the values in streaming, is there a way we can use python in a stream transformation?