Forum Discussion

Magic_Mads's avatar
Magic_Mads
Frequent Visitor
1 year ago
Solved

SQL Server Mirroring - special characters

Copy Job cannot handle special characters (eg. /) in column names - does SQL server Mirroring have the same issue - the documentation states that special characters are managed - list a number - but ...
data engineering
  • v-prasare's avatar
    v-prasare
    1 year ago

    Hi Magic_Mads,

     

    Microsoft Fabric relies on Delta Lake and Parquet formats under the hood for storage and querying. These technologies, along with Fabric’s mirroring and Lakehouse architecture, impose restrictions on special characters in column names due to file system compatibility and query engine parsing rules.

    column names with special characters may cause errors in mirroring, dataflows, and Spark operations. The / character, although sometimes accepted in SQL Server, can break schema inference and querying in Fabric.

     

    Thanks,

    Prashanth Are

    MS Fabric community support

     

BhaveshPatel's avatar
BhaveshPatel
Icon for Super User rankSuper User
1 year ago

Some of the data from SQL Server on-premises is not migrated to Fabric Mirror because They are the concept of using Windows vs Linux Systems. Until now, Microsoft (Windows ) was using SQL Server on premises whereas Fabric SQL ( Mirror ) is using Linux Systems. so, Definitely there is some mismatch for example, Copy jobs in Linux ( Delta Lake ) are using decimal data as compare to money data in Windows ( SQL Server on premises). 

 

SQL Server on premises

 

 

  • Magic_Mads's avatar
    Magic_Mads
    Frequent Visitor
    1 year ago

    Hi - it is Fabric Mirroring (SQL Server on-prem) - not in any way related to Windows vs. Linux

    • BhaveshPatel's avatar
      BhaveshPatel
      Icon for Super User rankSuper User
      1 year ago

      Behind the scene, it is Windows vs Linux Systems. You can not see this but We can see this behind the scene.

       

      Also, In Delta Lake ( Linux Systems ), We are using Schema Evolution/ Schema Enforcement whereas in old days ( 8 yrs before ), there was only schema enforcement in SQL Server on premises. 

      • Magic_Mads's avatar
        Magic_Mads
        Frequent Visitor
        1 year ago

        But - will a column name containing / work or not using Fabric Mirroring?