https://community.fabric.microsoft.com/t5/Developer/Union-Nested-Tables-in-Custom-Connector/m-p/717967#M19695 <P><FONT face="arial,helvetica,sans-serif">Hi Folks, I've created a custom connector which pulls data over a REST API. Let's say the API exposes two endpoints, Departments and Events, where there are 10 departments and 100 million events per department. As an end user of the connector, I will only be interested in perhaps three of the 10 departments' events so I would rather not import a billion events just to post filter them. The Events endpoint does permit filtering by Department.</FONT></P><P>&nbsp;</P><P><FONT face="arial,helvetica,sans-serif">I'm using a nested navigation table to allow selection of the desired Departments' Events data, and while this achieves the goal of limiting the data retrieved, I'm left with one Event table per Department. Is it possible for the connector to union these nested tables into a single Events table? Sure, the user can easily do that using the PQ Editor, but I'd love to make it even easier for them. Likewise, I'd like to provide the filtered list of Departments from their previous (navigation) selections. Easy to do in PQ using references and joins, but I'm stumped how to achieve this entirely within the connector (if it's even possible).</FONT></P> Tue, 18 Jun 2019 16:04:29 GMT Arktan 2019-06-18T16:04:29Z https://community.fabric.microsoft.com/t5/Developer/Union-Nested-Tables-in-Custom-Connector/m-p/717967#M19695 <P><FONT face="arial,helvetica,sans-serif">Hi Folks, I've created a custom connector which pulls data over a REST API. Let's say the API exposes two endpoints, Departments and Events, where there are 10 departments and 100 million events per department. As an end user of the connector, I will only be interested in perhaps three of the 10 departments' events so I would rather not import a billion events just to post filter them. The Events endpoint does permit filtering by Department.</FONT></P><P>&nbsp;</P><P><FONT face="arial,helvetica,sans-serif">I'm using a nested navigation table to allow selection of the desired Departments' Events data, and while this achieves the goal of limiting the data retrieved, I'm left with one Event table per Department. Is it possible for the connector to union these nested tables into a single Events table? Sure, the user can easily do that using the PQ Editor, but I'd love to make it even easier for them. Likewise, I'd like to provide the filtered list of Departments from their previous (navigation) selections. Easy to do in PQ using references and joins, but I'm stumped how to achieve this entirely within the connector (if it's even possible).</FONT></P> Tue, 18 Jun 2019 16:04:29 GMT https://community.fabric.microsoft.com/t5/Developer/Union-Nested-Tables-in-Custom-Connector/m-p/717967#M19695 Arktan 2019-06-18T16:04:29Z