Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The ultimate Microsoft Fabric, Power BI, Azure AI & SQL learning event! Join us in Las Vegas from March 26-28, 2024. Use code MSCUST for a $100 discount. Register Now

Reply
gomezc73
Helper IV
Helper IV

Static table Vs dinamic table

Hi,

 

I would appreciate if you can guide me on the best way to handle this:

 

I am creating a Balance report in PBI, where I need the data from 2 years back to today (I am using JD Edwards).

 

Of course I already made a query that extracts the data, but the Refresh is a bit slow.

 

So I wanted to do the following:

 

a. To have the data from 2020 to last month, in a table that will be refreshed monthly, the day of accounting close. (It would be the Historical data)


b. On the other hand, to have in another table that makes the daily refresh with the transactions of the day to have the information of the current month.

 

This way I could make a UNION or MERGE to join both tables and in this way, the report would be faster.


I would appreciate if you can guide me on how to handle it.

 

Note: I don't if it is possible to schedule a refresh in different times for two tables in the same report..

Greetings.

 

1 ACCEPTED SOLUTION
v-angzheng-msft
Community Support
Community Support

Hi, @gomezc73 


Incremental Refresh is the process of loading only part of the data that might change, and adding it to the previous dataset which is not changing anymore.

Incremental refresh extends scheduled refresh operations by providing automated partition creation and management for dataset tables that frequently load new and updated data.
With incremental refresh, the service dynamically partitions and separates data that needs to be refreshed frequently from data that can be refreshed less frequently. 

Refer:
Incremental refresh and real-time data for datasets

Configure incremental refresh and real-time data


More:
https://www.sqlshack.com/an-overview-of-power-bi-incremental-refresh/

https://biinsight.com/implementing-incremental-refresh-in-power-bi-part-1/

https://radacad.com/all-you-need-to-know-about-the-incremental-refresh-in-power-bi-load-changes-only

 

 

Best Regards,
Community Support Team _ Zeon Zheng


If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

5 REPLIES 5
v-angzheng-msft
Community Support
Community Support

Hi, @gomezc73 


Incremental Refresh is the process of loading only part of the data that might change, and adding it to the previous dataset which is not changing anymore.

Incremental refresh extends scheduled refresh operations by providing automated partition creation and management for dataset tables that frequently load new and updated data.
With incremental refresh, the service dynamically partitions and separates data that needs to be refreshed frequently from data that can be refreshed less frequently. 

Refer:
Incremental refresh and real-time data for datasets

Configure incremental refresh and real-time data


More:
https://www.sqlshack.com/an-overview-of-power-bi-incremental-refresh/

https://biinsight.com/implementing-incremental-refresh-in-power-bi-part-1/

https://radacad.com/all-you-need-to-know-about-the-incremental-refresh-in-power-bi-load-changes-only

 

 

Best Regards,
Community Support Team _ Zeon Zheng


If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Thank you, this information is very useful

@v-angzheng-msft be careful not to mix up incremental refresh with differential refresh. Incremental refresh does NOT address data changes. It assumes immutability of data written to older partitions. It should have been called "Selective Partition Flush&Fill" but that probably wasn't a cool enough name.

 

 

Hi, @lbendlin 

Thanks for your reply, the above statement comes entirely from the article above.

 

 

Best Regards,
Community Support Team _ Zeon Zheng

lbendlin
Super User
Super User

You don't really need to do that.  Read about Incremental Refresh.

Helpful resources

Announcements
Fabric Community Conference

Microsoft Fabric Community Conference

Join us at our first-ever Microsoft Fabric Community Conference, March 26-28, 2024 in Las Vegas with 100+ sessions by community experts and Microsoft engineering.

February 2024 Update Carousel

Power BI Monthly Update - February 2024

Check out the February 2024 Power BI update to learn about new features.

Fabric Career Hub

Microsoft Fabric Career Hub

Explore career paths and learn resources in Fabric.

Fabric Partner Community

Microsoft Fabric Partner Community

Engage with the Fabric engineering team, hear of product updates, business opportunities, and resources in the Fabric Partner Community.