Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
Anonymous
Not applicable

Help Needed with Data Flows

Hello community, 

 

Hope every one are safe!!  

 

I have a question and wanted to know if data flows can help us with this requirement . We have huge volumes of data in one of our reporting databases. ( Say from 2016 ) . By every passing year, they delete one year of data and free up the space. For example, we are in year 2020 and we have data from 2016 . In next year 2021,2016 data will be deleted .  For reporting uses, we need data of 2016 as well. 

 

Can data flows help us in archiving this data and doesnt get deleted at all ?

 

 

2 REPLIES 2
Anonymous
Not applicable

Hi Community, 

 

Does any one have a solution for the scenario i explained below. Please help me with this requirement as we need to discuss with client as soon as possible. 

Hi , @Anonymous 

When execute a refresh on next year, the query will execute again and get data from source, the data for year 2016 will loss because there are no such data in source, so we can create another data flow which filter the data in year 2016 and do not refresh it again to store the data for 2016.(if execute refresh again, the stored data will lose and be replaced with new one). you can also use other database to store the entire data, then connect data flow to  it.

 

Best Regards,
Community Support Team _ Eason

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors
Top Kudoed Authors