Forum Discussion
Python add data to existing table based on existing data
Hi, Anonymous
Could you consider turning off both options in power query?
And try not to add data sources that you don't want to refresh after publishing to the service.
Did I answer your question? Please mark my reply as solution. Thank you very much.
If not, please feel free to ask me.
Best Regards,
Community Support Team _ Janey
AFAIK, you can't use py to read datasets existing in PBI because they are not stored as separate files.
PQ itself is a powerful ETL tool; I don't see the point resorting to a third-party script to manipulate dataset already existing within PQ.
gb_list = test['Column2']What I try to do is scrape a webpage with a lot of data and each time I start PBI I want to add the latest records and not load the everything again because this would take ages. Besides the initial data comes from one webpage and the added data from another. I hope this makes sense.
Hi, Anonymous
Could you consider turning off both options in power query?
And try not to add data sources that you don't want to refresh after publishing to the service.
Did I answer your question? Please mark my reply as solution. Thank you very much.
If not, please feel free to ask me.
Best Regards,
Community Support Team _ JaneyThanks, I was not aware of these settings.
It was getting a bit complicated to collect all data directly in powerBI. For now I collect the main part in mySQL (using python scipt) and use mySQL as source in PowerBI