Forum Discussion

sschuetz's avatar
sschuetz
Frequent Visitor
2 years ago

Postgres CDC numeric as Bigdecimal binary

Hi 

 

When using Postgres CDC in the realtimehub, all numeric values are loaded as bigdecimal binary.

these are hard to convert.

debezium supports a setting to change this, can this be done somehow with fabric?

eventstream

2 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi sschuetz ,

     

    As a workaround, consider implementing a data transformation step within your data pipeline. This can be done by using Azure Data Factory or a similar service to transform values into a more desirable format before or after the CDC process.

    For more details, please refer:  Ingest data into your Warehouse using data pipelines - Microsoft Fabric | Microsoft Learn

     

    Best Regards,

    Neeko Tang

    If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

    • sschuetz's avatar
      sschuetz
      Frequent Visitor
      2 years ago

      Hi Neeko

       

      We wanted to use the values in streaming, is there a way we can use python in a stream transformation?