Forum Discussion

michellmadeira's avatar
michellmadeira
Frequent Visitor
5 years ago

Datasource with too many applied steps not refreshing

Hi, 

 

I have this data source with too many applied steps, and can't refresh with my gateway cluster on PowerBI online service (below).

Clicking it has no effect anymore: 

 

 

Here you can have a glance at the too many applied steps I've told you so (close to 100 to be more specific):

 

 

Case:

 

I am connecting Pipedrive API to retrieve items (business deals in this case) snapshot, and studying the API, the only solution was to use individual calls by id using the bellow endpoint:

 

https://fitbank.pipedrive.com/api/v1/deals/{id}

 

After massive testing, I've noticed that gateway clusters do not allow data sources with dinamycally added columns (M "Table.AddColumn" with Functions, for instance), nor data sources with individual applied steps with huge instructions (M "Table.Combine" with ~500 tables).

 

The last alternative was to combine each table individually as specific applied steps (which turned to be ~500) regarding the data I need. By the way, with this strategy, when we have only 10 tables it worked fine, and now with just ~100 it doesn't work.

 

Any alternatives to this strategy or to deal with gateway cluster limitation?

 

Thanks in advance.

5 Replies