Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago

Fastest Solution for Data Refresh

Hi all,   I guess similar questions may have been asked before, but I'm getting lots of different ideas and am totally lost. So let me ask this again with my use case below. Current account: PPU ...
Need Help
collinq's avatar
collinq
Super User
4 years ago

HI Anonymous ,

 

This can get quite complex quite quickly.  You have two big concerns as I see it - the refresh ability and the licensing to let that refresh happen.  And, each option has its own set of limitations, options and considerations.  My first guess is that you would want a live connection.

Here is an article explaining the different type of connections:

DirectQuery, Live Connection or Import Data? Tough Decision! - RADACAD

 

If you are looking for streaming data, you can read this here:

Real-time streaming in Power BI - Power BI | Microsoft Docs

 

You will need licenses that are appropriate and this link shows some guidance for that:

Streaming dataflows (preview) - Power BI | Microsoft Docs

 

Anonymous's avatar
Anonymous
Not applicable
4 years ago

Thanks collinq 

I've honestly read all of those docs. 

Since I don't have a direct connection to the original database, what is the fastest way to sync data to a source that can be used for either DirectQuery or Live Connection? 

I mean that sync will be the bottleneck for the updates. Reports can only get updated as fast as the sync goes.

  • collinq's avatar
    collinq
    Super User
    4 years ago

    Hey Anonymous ,

     

    I think that Live Connection should be faster since it is just hitting the existing schema.

    • Anonymous's avatar
      Anonymous
      Not applicable
      4 years ago

      I actually had some success with the Power BI API, but only in Powershell.

      My next step would be to build a cron job with Python and call the refresh API every so often. But the Azure authentication is really complex and not well documented. I'm extremely confused with client id, service principal, app secrets and how/what to use in my script. Everything I can find online now is either somewhat based on an older version of Azure and doesn't apply much, or they talk about different routes that stop halfway.

      Can you recommend a tutorial that can walk me through end to end?

      Thank you so much!