Forum Discussion

ebjim's avatar
ebjim
Resolver I
1 year ago
Solved

Importing from Survey Monkey

I am using a dataflow gen2 to connect to a Survey Monkey table. With SM, the question is the header and the answers come up as content. When initially imported, the SM stuff is of data type Any. I ha...
data engineering
Lakehouse
  • v-prasare's avatar
    v-prasare
    1 year ago

    Hi ebjim,

     

    Even though you converted columns to Text in Dataflow Gen2, the underlying data might still be nullable or contain mixed null values, and when writing to a Lakehouse Delta table, this often causes the data to silently fail to persist, especially if:

    • The schema inference in Delta Lake cannot reconcile inconsistent or null-only columns.

    • Data type promotion or conversion fails without error surfacing clearly.

    • Blank rows are considered "valid" but not written as expected due to schema enforcement.

     

     

     

    Thanks,

    Prashanth Are

    MS Fabric community support

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

     

v-prasare's avatar
v-prasare
Community Support
1 year ago

ebjim, As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for your issue worked? or let us know if you need any further assistance here?

 

 

 

Thanks,

Prashanth Are

MS Fabric community support

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query