Azure Databricks Power Query Connection in Import Mode Results in Duplicate Records

[kthxbye]

I'm connecting to Databricks via the Azure Databricks connector in my Power BI Dataset. When I query the data for this table (factopensalesorderinventorylines) in Import mode, all the records are duplicated. When I query the same data from Databricks in Direct Query, there is no duplication.

Import Mode Power Query M:

let
  Source = Databricks.Contents(
    "nautilus-prod.cloud.databricks.com",
    " /sql/1.0/endpoints/e8fe3e2cc3c02229",
    [Database = null, EnableExperimentalFlagsV1_0_7 = null]
  ),
  SPARK_Database = Source{[Name = "SPARK", Kind = "Database"]}[Data],
  supplychain_Schema = SPARK_Database{[Name = "supplychain", Kind = "Schema"]}[Data],
  factopensalesorderinventorylines_Table = supplychain_Schema
    {[Name = "factopensalesorderinventorylines", Kind = "Table"]}
    [Data]
in
  factopensalesorderinventorylines_Table

Direct Query Power Query M (identical):

let
  Source = Databricks.Contents(
    "nautilus-prod.cloud.databricks.com",
    " /sql/1.0/endpoints/e8fe3e2cc3c02229",
    [Database = null, EnableExperimentalFlagsV1_0_7 = null]
  ),
  SPARK_Database = Source{[Name = "SPARK", Kind = "Database"]}[Data],
  supplychain_Schema = SPARK_Database{[Name = "supplychain", Kind = "Schema"]}[Data],
  factopensalesorderinventorylines_Table = supplychain_Schema
    {[Name = "factopensalesorderinventorylines", Kind = "Table"]}
    [Data]
in
  factopensalesorderinventorylines_Table

Duplicates:

I'm not doing any transformations on the data. There's no difference in the Import vs. Direct Query queries. I'm connecting to a Databricks database via SQL endpoint. Any ideas at all on what's happening here and how to fix it?

My Power BI version is 2.96.901.0 64-bit (August 2021). 

[v-chuncz-msft]

@kthxbye 

I cannot reproduce it. You may try latest version and earlier versions from Power BI updates archive to check if the issue exists as well.