Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
eliasayyy
Super User
Super User

Store data into new table aa static after api call

Hello everyone, so i have a ppwwr query code that extracts data from api, however as the days go up, the data gets bigger or i start hitting those rate limits, i knoe that i can use databases to store but i dont have servers and im a newbie in this area as im no data engineer. 

 

My question is if there is a way to store my data after the call to be static in another table. So like after table A got me the api call i needed, i create a new function that will store all my data in Table B and append them as i hit a new call.

 

Maybe if i create a function or something? If anyone have suggestion olease let me know

2 REPLIES 2
v-junyant-msft
Community Support
Community Support

Hi @eliasayyy ,

@lbendlin Thanks for your concern about this case!

And @eliasayyy , If I understand you correctly, what you mean by static storage is that only the data is stored, and any data transformation steps that occur in table A do not occur in table B, except for the addition of new data. Is that what you mean?
If I remember correctly, only Duplicate can do this in Power Query.

vjunyantmsft_0-1715309214675.png

 

vjunyantmsft_1-1715309291249.png

My suggestion is to Duplicate table A before you do any transformations on table A. Then you add a step in table A(2) using the M function to query what data rows do not exist in the Source step of table A that are not present in the current table A(2) and then append those data rows to the current table A(2).
This way, when you have new data to add to Table A (as long as there are no rows that are identical to the existing data), it should be automatically added to Table A(2), and any data transformations to Table A will not be applied to Table A(2).
However, this is a step-by-step process that needs to be further realized depending on your data.

Best Regards,
Dino Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

lbendlin
Super User
Super User

Power BI has no memory* . You need to manage your snapshots in the upstream system.

 

* Yes, there is the self referencing option but that has no safety net.

 

Helpful resources

Announcements
July 2024 Power BI Update

Power BI Monthly Update - July 2024

Check out the July 2024 Power BI update to learn about new features.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

Top Solution Authors
Top Kudoed Authors