This is best Fabric, Power BI, SQL and AI community event. How do we know? The last event sold out! Save €200 with code FABCMTY200.
Register nowThe Fabric community is now in read-only for platform upgrade. Learn more
I have a dynamic database, and I want to keep a history of the data while adding only the new data with each weekly or monthly update. I would like to achieve this in Power Query. Is it possible? Incremental refresh is not an option, and I don't want to export data to SharePoint files using Power Automate.
It is not easily possible in power query.
if you use Power Bi, maybe you can add a step by using Python script to export the result into CSV and then use that inside the code also,
if you use Excel, it become a little bit more challenging
Yes I'm using Power BI, is it possible to add a python code to extract the data in cvs file (millions of rows) ?
Dump data out of the database before it is replaced?
Or just leave the data in the database? Don't delete anything.
Regards
Phil
Proud to be a Super User!
No not possible. PQ isn't able to store data, it loads data from the datasource every time the query is refreshed.
Phil
Proud to be a Super User!
Join us in Barcelona for FabCon and SQLCon, the Fabric, Power BI, SQL, and AI community event. Save €200 with code FABCMTY200.