Forum Discussion

Magic_Mads's avatar
Magic_Mads
Frequent Visitor
1 year ago
Solved

SQL Server Mirroring - special characters

Copy Job cannot handle special characters (eg. /) in column names - does SQL server Mirroring have the same issue - the documentation states that special characters are managed - list a number - but ...
data engineering
  • v-prasare's avatar
    v-prasare
    1 year ago

    Hi Magic_Mads,

     

    Microsoft Fabric relies on Delta Lake and Parquet formats under the hood for storage and querying. These technologies, along with Fabric’s mirroring and Lakehouse architecture, impose restrictions on special characters in column names due to file system compatibility and query engine parsing rules.

    column names with special characters may cause errors in mirroring, dataflows, and Spark operations. The / character, although sometimes accepted in SQL Server, can break schema inference and querying in Fabric.

     

    Thanks,

    Prashanth Are

    MS Fabric community support

     

Magic_Mads's avatar
Magic_Mads
Frequent Visitor
1 year ago

Hi - it is Fabric Mirroring (SQL Server on-prem) - not in any way related to Windows vs. Linux

BhaveshPatel's avatar
BhaveshPatel
Icon for Super User rankSuper User
1 year ago

Behind the scene, it is Windows vs Linux Systems. You can not see this but We can see this behind the scene.

 

Also, In Delta Lake ( Linux Systems ), We are using Schema Evolution/ Schema Enforcement whereas in old days ( 8 yrs before ), there was only schema enforcement in SQL Server on premises. 

  • Magic_Mads's avatar
    Magic_Mads
    Frequent Visitor
    1 year ago

    But - will a column name containing / work or not using Fabric Mirroring?