Forum Discussion
Solved
Automatically append daily data that is scraped from a website to a master table
I am trying to scrape data off a public website that lists daily foriegn exchange rates, and then append that data to a master table that is capturing all historic days. There are systems out th...
You cannot do this in Power BI - it has no memory. However, you can create a Power Automate Flow that pulls the data on a daily basis and writes it into daily CSV files. You can then point Power BI to that folder and ingest all the CSV files. You can even implement incremental refresh based on file date but that's probably overkill given the small sizes.
Hi i'm trying to do something similar where I am already daily data from a ODATA connection (to Jira) and I won't the append the results as part of the automated daily refresh to another table. the Append query tabel deosn't seem work as it's just the one table I want to "append" to. I'd prefer to avoid a csv folder if at all possible ?
I'd prefer to avoid a csv folder if at all possibleand why would that be?