Forum Discussion

Evogelpohl's avatar
Evogelpohl
Helper V
9 years ago
Solved

Need a Sleep or Wait step in my Query - hitting API rate limits

I have a working Power query function to pass ~12,000 tweets to MS cognitive sentiment API.  Working just fine.   I'm paying for the S1 (100,000 calls / 30 days) pricing teir.  Even in testing my s...
  • DataChant's avatar
    DataChant
    9 years ago

    BTW - You may want to re-evaluate your approach. From the initial code above, you post a single message per API call. Instead you can send 1000 messages in a single API call, and repeat it on your entire dataset. You can learn how to do it in my blog here.

GilbertQ's avatar
GilbertQ
Super User
9 years ago

I would say possibly to move the delay then before it makes the web call and see if that works?

 

It might just be to find the right place before it makes the web call, and looking at it now, there is no use to put it after the web call, but before?

DataChant's avatar
DataChant
Most Valuable Professional
9 years ago

BTW - You may want to re-evaluate your approach. From the initial code above, you post a single message per API call. Instead you can send 1000 messages in a single API call, and repeat it on your entire dataset. You can learn how to do it in my blog here.

  • Evogelpohl's avatar
    Evogelpohl
    Helper V
    9 years ago

    DataChant thanks.  At some point in my power query learning - most likely from reading Kurt H's posts - I got fixated on the process of making functions out of queries and then using the add column pattern to add data to an existing source.  I'm going to try to crack this nut, else I'll adopt your pattern.  -Eric.