Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get inspired! Check out the entries from the Power BI DataViz World Championships preliminary rounds and give kudos to your favorites. View the vizzies.

Reply
Milejdi8
Frequent Visitor

Incremental refresh cutting out last two months

Hello, 

I have a dataset connected to Azure Databricks (multiple pbi reports connected to multiple tables; only this one table has this kind of issue). 
The problem: in PBI Desktop, I see all the data properly, in line what is set up by parameters, up to yesterdays data.
When I publish to PBI Service, the last day is either end of month three months ago (31.01.2024, for the report published few weeks ago) or two months ago (29.02.2024, for the report I publish now). 
No matter how I set up parameters, how I set incremental refresh or dataset on service, as soon as I publish the report and it does the initial data pull, it never shows the last two months of data. 

The query looks like this: 

let
Source = Databricks.Catalogs("a-number-code-goes-here.azuredatabricks.net", "/sql/1.0/warehouses/a-different-code-goes-here", [Catalog=null, Database=null, EnableAutomaticProxyDiscovery=null]),
hive_metastore_Database = Source{[Name="hive_metastore",Kind="Database"]}[Data],
database_name_Schema = hive_metastore_Database{[Name="database_name",Kind="Schema"]}[Data],
table_name_Table = database_name_Schema{[Name="table_name",Kind="Table"]}[Data],
#"Incremental Refresh Filter" = Table.SelectRows(table_name_Table, each [calday] > Date.From(RangeStart) and [calday] < Date.From(RangeEnd))
in
#"Incremental Refresh Filter"

 

Incremental setup is here:

Milejdi8_1-1712073742503.png

 

Please note that this same setup and same query (only calling different tables but from the same database) works for multiple other reports without an issue; nothing that I googled ever showed similar issue... so I'm honestly at my wits end here - please help!

1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

Your RangeStart and RangeEnd filters are wrong.  One of them must be inclusive, the other must be exclusive.

View solution in original post

1 REPLY 1
lbendlin
Super User
Super User

Your RangeStart and RangeEnd filters are wrong.  One of them must be inclusive, the other must be exclusive.

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

FebPBI_Carousel

Power BI Monthly Update - February 2025

Check out the February 2025 Power BI update to learn about new features.

Feb2025 NL Carousel

Fabric Community Update - February 2025

Find out what's new and trending in the Fabric community.