Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
harib
Post Patron
Post Patron

Incremental Refresh with Limited Data

I have a data like 20 millions for 3 year.

My requirment is  , I would like to load 1 month data in the desktop for development and also needs to implement incremental refresh. 

 

I have a Date field like this  (3/1/2018 12:00:00 AM) and I'm able create and define the parameters to that field. But only the thing is i would like to load 1 month data in the Desktop and reamining data would like to load in service.

 

Is there any possibilities to achive this.

 

Thanks in Advance

2 REPLIES 2
TomMartens
Super User
Super User

Hey @harib ,

 

unfortunately, it's not that simple, this is because of the initial load.

Basically, it's not possible to chunk existing data and load just a portion into Power BI Desktop and the remaining chunks will be loaded during the 1st load on the Service. Incremental refresh works exactly that way, but unfortunately, it's assuming that data is growing over time and not already there 🙂
If your workspace is backed by a premium license like P or Premium user this article might help you: https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-xmla?WT.mc_id=DP-MVP-5003...

 

Please be aware that using advanced partition management requires some experience. If you are going down the road of partitions, it's also a good idea to start using the ALM-toolkit and Tabular Editor. Next to that separate your development into two pbix files one is used for the data model and the configuration of the incremental and the 2nd one is used for the development of the content: meaning your data visualizations.

The data source for the 2nd pbix file is the Power BI dataset created after publishing the 1st pbix file.

 

Hopefully, this adds some useful information.

 

Regards,

Tom



Did I answer your question? Mark my post as a solution, this will help others!

Proud to be a Super User!
I accept Kudos 😉
Hamburg, Germany
lbendlin
Super User
Super User

Yes, that is standard functionality.  You can define values for RangeStart and RangeEnd in the Power Query parameters dialogue that limit your development date range.  These values have no impact whatsoever (*) on the actual implementation of incremental refresh (which is controlled by the retention and refrehs periods).

 

*) well, sort of.  Whenever you re-publish the pbix file the users will briefly see data for your dev date range until the regular incremental refresh completes again.

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

Top Solution Authors