Forum Discussion

AlexanderPowBI's avatar
AlexanderPowBI
Icon for Resolver I rankResolver I
2 years ago
Solved

Ingesting Varchar(MAX) to datawarehouse failure

Hello,   I am trying to build a pipeline for a table we have in our azure sql database into Fabric. One of the columns has varchar(MAX) and can be quite large (intentionally).  When I try to use t...
data engineering
Data Integration
data warehouse
  • AlexanderPowBI's avatar
    AlexanderPowBI
    2 years ago

    Hi,

    So I found it possible to save records larger than the 8000 limit into a delta table in lakehouse, but as you wrote, the SQL analytic endpoint will truncate it. 

    I have went on and remodelled the column in a notebook to continue my work. Thank you for your answers! 

Koen_Verbeeck's avatar
Koen_Verbeeck
Icon for Advocate II rankAdvocate II
2 years ago

Even though the reasons for not having varchar(max) are valid, they are a poor excuse for not supporting it. Every other SQL product in the Microsoft family supports it, but not Fabric. This will make migrations harder. Sometimes we don't have a choice. For example, the source database has a column storing JSON data, which can easily go over 8000 characters. But there's no option to get this data into Fabric...

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi Koen_Verbeeck ,

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to consider this request in priority.