topic Re: Postgres CDC numeric as Bigdecimal binary in Eventstream

Postgres CDC numeric as Bigdecimal binary

sschuetz — Wed, 05 Jun 2024 20:46:13 GMT

When using Postgres CDC in the realtimehub, all numeric values are loaded as bigdecimal binary.

these are hard to convert.

debezium supports a setting to change this, can this be done somehow with fabric?

Re: Postgres CDC numeric as Bigdecimal binary

Anonymous — Thu, 06 Jun 2024 02:21:49 GMT

As a workaround, consider implementing a data transformation step within your data pipeline. This can be done by using Azure Data Factory or a similar service to transform values into a more desirable format before or after the CDC process.

For more details, please refer: Ingest data into your Warehouse using data pipelines - Microsoft Fabric | Microsoft Learn

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly.

Re: Postgres CDC numeric as Bigdecimal binary

sschuetz — Wed, 12 Jun 2024 12:25:57 GMT

Hi Neeko

We wanted to use the values in streaming, is there a way we can use python in a stream transformation?