topic Re: Filtering selected tables with data in Dataflow Gen2 to Fabric in Dataflow

Filtering selected tables with data in Dataflow Gen2 to Fabric

nalakan — Fri, 03 May 2024 10:29:29 GMT

Hi Folks,
I am trying to ingest data from on prem sql server to fabric via data flowflow Gen2 .I just need to select a particular schema(e:g finance) and views that starting from letter "X" ,i need to ingest via gen2. I can query the data via sql statement as below.

But what is happening afterwords in next screen(PQ window) is i am not getting the actual tables as a hierarchy of tables to select,instead table names in tabular format.
So that kind of requirement can we do with dataflows gen 2, pipeline activity in fabric.since it is difficult to select one by one tables in the UI if it is having 1000+ etc views/tables.

Thanks in advance

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

Anonymous — Fri, 03 May 2024 07:21:15 GMT

Hi nalakan ,

Thanks for using Fabric Community.
Can you please share the screenshot of the next page and describe little about your issue, so I can guide you better?

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

nalakan — Fri, 03 May 2024 10:03:56 GMT

Thanks. Anonymous
(sry for the blurred image)

What i want is yellow coloured tables as a tree view in left side with data as normal import scenario in gen2.( purple color).

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

Anonymous — Fri, 03 May 2024 10:18:47 GMT

Hi nalakan ,

As I understand you will get output of the sql query mentioned during connection in PQ View.
I am unable to understand why are you expecting a different tree view structure?
Are you expecting to connecting to your On-Prem SQL Server directly in Fabric?

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

nalakan — Fri, 03 May 2024 10:20:57 GMT

Yes.via gateway .
It is not a different tree view .I just need to filter the tables based on my condition that mentioned earlier.

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

Anonymous — Fri, 03 May 2024 10:27:44 GMT

Hi nalakan ,

Did you got a chance to check this option?
With the help of the filter you can select the required rows.

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

nalakan — Fri, 03 May 2024 10:28:14 GMT

yes.this is only filtering table names.related data in the tables can not obtained in this method.

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

Anonymous — Fri, 03 May 2024 10:29:32 GMT

Hi nalakan ,

You can get below view if you do connection directly without mentioning the query.

Please let me know if this is what you are looking for.

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

nalakan — Fri, 03 May 2024 10:31:11 GMT

This is fine for few tables.but as i mentioned ,i have 1000 + tables.so it is not practical to invdiually select the tables starting from letter "x" .You got my requirement?

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

Anonymous — Fri, 03 May 2024 10:40:59 GMT

Hi nalakan ,

I was able to understand your issue. Unfortunately at present we only have this option.

Appreciate if you could share the feedback on our feedback link , which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.
Feedback Link : Home (microsoft.com)

Hope this helps. Please let me know if you have any further questions.

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

nalakan — Fri, 03 May 2024 10:44:59 GMT

Oh,is that so...
Sure.vl share via feedback link.
Thanks for your support.

Re: Filtering selected tables with data in Dataflow Gen2 to Fabric

Anonymous — Fri, 03 May 2024 10:57:27 GMT

Hi nalakan ,

I hope you got some insights on your query. You can let me know if there is any further queries.
Please continue using Fabric Community on your further queries.