Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago
Solved

Nondescript error when copying data from on prem SQL to Fabric LH using ADF Connector

Trying to copy data from on-prem SQLServer to Fabric LH via ADF SHIR Lakehouse Linked Service Connection...

 

Source table has 5 rows and uses varchar(1024), datetime, and bigint datatypes. There is a nonclustered PK defined and a unique clustered index (on the source). 

 

I've copied 148 other tables from the same source and to the same destination without issue. 

 

The error in ADF:

Getting an error when copying SqlServer to Fabric LH...

'Type=System.InvalidOperationException,Message=Initial commit requires metadata,Source=Microsoft.DataTransfer.Richfile.DeltaFormatPlugin,'

 

Any guidance or anything to look out for that could be causing this error?

 

Appreciate your time.

Need Help
pipelines
  • Anonymous's avatar
    Anonymous
    2 years ago

    I figured it out! My source query was incorrectly adding the same column twice when copying from on prem to Fabric LH in Azure Data Factory.

     

    So this error was just saying "invalid schema" 

3 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Tried changing the Unique Cluster Index to Nonclustered and still getting this error.

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Hi Anonymous ,

      Thanks for using Fabric Community.
      Can you please help me understand which data factory are you using? Is it Azure Data Factory or Fabric Data Factory?

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    I figured it out! My source query was incorrectly adding the same column twice when copying from on prem to Fabric LH in Azure Data Factory.

     

    So this error was just saying "invalid schema"