Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now

Reply
Thommo_71
New Member

Can I refresh a web based CSV in direct query mode?

I have a link to a csv which is a live snapshot of the National Electricity prices.

I need it every 30 minutes.

We have an on premis gateway.

I have multiple direct queries back to our SQL server which refresh nicely, but the link to the CSV file doesn't refresh unless I go into the source and manually refresh it.

Is it possible? Or do I have to store it temporarily in SQL?

this is the CSV (public)  https://nemlog.com.au/api/rgn/NSW1/csv

1 ACCEPTED SOLUTION
Jonvoge
Super User
Super User

Hi Thommo_71

 

You can't make DirectQuery connections to a CSV file.

You can however schedule frequent refreshes to run (8 times per day with Pro license, 48 hours per day with Premium per user/capacity). If you wish DirectQuery capabilities, the SQL approach that you mention yourself is indeed a way to go.

_____________________________________________________
I hope my comment was helpful.
If your question was answered, please mark your post as 'Solved' and consider giving me a 'Thumbs Up'.
Find me on LinkedIn, Sessionize, or my blog Downhill Data

View solution in original post

2 REPLIES 2
Tutu_in_YYC
Community Champion
Community Champion

Another option is to do a targeted table refresh using API i.e you only refresh the table that pulls data from the CSV, and you can schedule this to run every 30mins for example using Logic app. 

https://learn.microsoft.com/en-us/power-bi/connect-data/asynchronous-refresh

Jonvoge
Super User
Super User

Hi Thommo_71

 

You can't make DirectQuery connections to a CSV file.

You can however schedule frequent refreshes to run (8 times per day with Pro license, 48 hours per day with Premium per user/capacity). If you wish DirectQuery capabilities, the SQL approach that you mention yourself is indeed a way to go.

_____________________________________________________
I hope my comment was helpful.
If your question was answered, please mark your post as 'Solved' and consider giving me a 'Thumbs Up'.
Find me on LinkedIn, Sessionize, or my blog Downhill Data

Helpful resources

Announcements
November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Live Sessions with Fabric DB

Be one of the first to start using Fabric Databases

Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.

Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.

Nov PBI Update Carousel

Power BI Monthly Update - November 2024

Check out the November 2024 Power BI update to learn about new features.