Forum Discussion

fabric_1's avatar
fabric_1
New Member
1 year ago
Solved

CommitFailedError:Writer features must be specified for writerversion >= 7, please specify: Timest**

HI,

 

I am using the below code to write data to append data to a deltatable using a fabric notebook using pure python,

write_deltalake(table_path, data=df, mode = 'append', schema_mode='merge', engine = 'rust', storage_options=storage_options)

I have a column that is in timestamp format and I have already removed the timezone from it.

df['_createdAt'] = pd.to_datetime(df['_createdAt']).dt.tz_localize(None)

However, I am facing the below issue and I am unable to append the data sucessfully.

CommitFailedError: Writer features must be specified for writerversion >= 7, please specify:TimestampWithoutTimezone

 

How do I specify writer features.

 

Kindly help!

data engineering
Lakehouse
Notebook
  • v-prasare's avatar
    v-prasare
    1 year ago

    Hi fabric_1 , 

    In this scenario i suggest you to raise a support ticket here. so, that they can assit you in addressing the issue you are facing. please follow below link on how to raise a support ticket:

    How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn

     

     

     

    Thanks,

    Prashanth Are

    MS Fabric community support

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

4 Replies

  • v-prasare's avatar
    v-prasare
    Community Support
    1 year ago

    Hi fabric_1,

     

    Delta Lake protocol Writer Version 7+ introduces new features that require explicit declaration of feature usage. One such feature is TimestampWithoutTimezone.

    Even though you've localized the timestamp to remove timezone, Delta Lake still expects you to declare that you're using timezone-less timestamps explicitly in the write_features parameter.

     

    If you are writing timestamp columns frequently and want to future-proof your pipeline:

    Always set write_features = ["TimestampWithoutTimezone"] when using writer version ≥ 7.

     

     

     

    Thanks,

    Prashanth Are

     

    • fabric_1's avatar
      fabric_1
      New Member
      1 year ago

      Thanks v-prasare, How do we actually specify it in the notebook?

       

      I tried write_features = ["TimestampWithoutTimezone"], this still doesn't seem to work.

  • v-prasare's avatar
    v-prasare
    Community Support
    1 year ago

    Hi fabric_1 , 

    In this scenario i suggest you to raise a support ticket here. so, that they can assit you in addressing the issue you are facing. please follow below link on how to raise a support ticket:

    How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn

     

     

     

    Thanks,

    Prashanth Are

    MS Fabric community support

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

  • v-prasare's avatar
    v-prasare
    Community Support
    1 year ago

    Hi, We are following up once again regarding your query. Could you please confirm if the issue has been resolved through the support ticket with Microsoft?

    If the issue has been resolved, we kindly request you to share the resolution or key insights here to help others in the community. If we don’t hear back, we’ll go ahead and close this thread.

    Should you need further assistance in the future, we encourage you to reach out via the Microsoft Fabric Community Forum. We’ll be happy to help.

     

    Thank you for your understanding and participation.