Forum Discussion

Thommo_71's avatar
Thommo_71
New Member
1 year ago
Solved

Can I refresh a web based CSV in direct query mode?

I have a link to a csv which is a live snapshot of the National Electricity prices.

I need it every 30 minutes.

We have an on premis gateway.

I have multiple direct queries back to our SQL server which refresh nicely, but the link to the CSV file doesn't refresh unless I go into the source and manually refresh it.

Is it possible? Or do I have to store it temporarily in SQL?

this is the CSV (public)  https://nemlog.com.au/api/rgn/NSW1/csv

Need Help
  • Jonvoge's avatar
    Jonvoge
    1 year ago

    Hi Thommo_71

     

    You can't make DirectQuery connections to a CSV file.

    You can however schedule frequent refreshes to run (8 times per day with Pro license, 48 hours per day with Premium per user/capacity). If you wish DirectQuery capabilities, the SQL approach that you mention yourself is indeed a way to go.

    _____________________________________________________
    I hope my comment was helpful.
    If your question was answered, please mark your post as 'Solved' and consider giving me a 'Thumbs Up'.
    Find me on LinkedIn, Sessionize, or my blog Downhill Data

2 Replies

  • Jonvoge's avatar
    Jonvoge
    Icon for Most Valuable Professional rankMost Valuable Professional
    1 year ago

    Hi Thommo_71

     

    You can't make DirectQuery connections to a CSV file.

    You can however schedule frequent refreshes to run (8 times per day with Pro license, 48 hours per day with Premium per user/capacity). If you wish DirectQuery capabilities, the SQL approach that you mention yourself is indeed a way to go.

    _____________________________________________________
    I hope my comment was helpful.
    If your question was answered, please mark your post as 'Solved' and consider giving me a 'Thumbs Up'.
    Find me on LinkedIn, Sessionize, or my blog Downhill Data