topic Re: Fabric: Add new dataset to access lakehouse view in Pipelines

Fabric: Add new dataset to access lakehouse view

Riskworks115 — Fri, 29 Mar 2024 13:27:17 GMT

Simple task, Trial Subscription. I need to get 3 columns from a lakehouse table to use as parameters to pass to an external API. I plan to use a LookUp activity and a ForEach activity to loop thru the values in the view to paas as parameters.

Chat GPT suggests this:

Create a Dataset for the View:

In your Synapse Analytics workspace, create a new dataset that points to the view in your lakehouse. Select the appropriate data store (e.g., Azure Synapse Analytics) and specify the database and view name in the dataset settings.

I can't get to the Synapse Studio via Fabric Portal as suggested. Copilot says to go to the Account manager, but I end up at the same Fabric home page.

1) Do I need to create a DS for this task in Synapse rather than Fabric?

2) How can I access Fabric Portal with this Trial subscription?

Re: Fabric: Add new dataset to access lakehouse view

Ayybee — Sun, 31 Mar 2024 17:02:12 GMT

To access the values from the three columns in the table, create a lookup activity and save it as a Variable.
Then, you can use a ForEach activity to pass the variable as a parameter.

Re: Fabric: Add new dataset to access lakehouse view

Anonymous — Mon, 01 Apr 2024 18:16:53 GMT

Hi Riskworks115 ,

Thanks for using Fabric Community.
As Ayybee said, you can use LoopUp activity to get the data and use Web Activity to make an API call.
You can also use Copy Activity (Source - Lakehouse, Destination - Web API), you can use mapping to send only required columns.

Hope this is helpful. Please let me know incase of further queries.

Re: Fabric: Add new dataset to access lakehouse view

Anonymous — Wed, 03 Apr 2024 07:57:45 GMT

Hi Riskworks115 ,

We haven’t heard from you on the last response and was just checking back to see if your query was answered.
Otherwise, will respond back with the more details and we will try to help .

Re: Fabric: Add new dataset to access lakehouse view

Riskworks115 — Wed, 03 Apr 2024 15:16:11 GMT

I think I am confusing how the connection works. I tried it again and successfully copied only the desired columns from a csv to a delta lake table. Thanks for the help.