Forum Discussion

Mathan1787's avatar
Mathan1787
Icon for Helper I rankHelper I
3 years ago

Datapipeline-LookUp-Lakehouse

Hi,   Look up activty in data pipeline has query option only for external data store type (for azure sql database) but when i select the delta table i cant able to query. what are the other option ...
pipelines
DennesTorres's avatar
DennesTorres
Icon for Power Participant rankPower Participant
3 years ago

Hi,

One possible workaround is to use a SQL Database connection and point to the lakehouse SQL Endpoint. It's not a perfect solution, but probably will work.

 

Kind Regards,

 

Dennes

ajarora's avatar
ajarora
Icon for Microsoft Employee rankMicrosoft Employee
3 years ago

Even the cross workspace limitation should be addressable by creating a shortcut to the remote lakehouse, in the current workspace.

  • DennesTorres's avatar
    DennesTorres
    Icon for Power Participant rankPower Participant
    3 years ago
    Hi,

This would only work if there is a lakehouse in both workspaces and it would only work as a source, not as a destination.

I understand that if I would like to break down the pipelines in different workspaces for organization purposes, I couldn't.

Kind Regards,

Dennes
    • ajarora's avatar
      ajarora
      Icon for Microsoft Employee rankMicrosoft Employee
      3 years ago

      You basically have a LH1 in Workspace1, and Pipeline with Lookup activity in Workspace2. Can you create a LH2 in Workspace2, which points to the LH1 in Workspace1, and use lookup activity against LH2 ?