incremental refresh
11 TopicsIssue with Incremental Refresh in Dataflows - Data from Previous Days Getting Deleted
Hello everyone, I have set up two dataflows to create an 8-day data history. The first dataflow (dataflow1) stores data from the past 24 hours and refreshes at 10:30:00 PM, 12:00:00 AM, and 6:00:00 AM. Next, I created a second dataflow (dataflow2) that is linked to dataflow1, and I configured an incremental refresh to retain data from the last 8 days by refreshing data from one day ago. I used a DateTime column for this purpose. Dataflow2 refreshes at 12:30:00 AM, 4:00:00 AM, and 6:00:00 AM. However, I noticed that after 12:00:00 AM each day, the data from the previous day gets deleted in dataflow2, which is not the expected behavior for maintaining an 8-day data history. I would like to understand what might be causing this data deletion and how to correct this configuration to preserve the complete 8-day history without data loss. Thank you in advance for your help!758Views0likes3CommentsIncremental refresh with a specific start date for dataset
Hi, I've my report connected to the Oracle Database, I have set up all my RangeStart/End and incremental refresh. I want to only imported dataset starting from 01/01/2023 to YTD - no data from 2022, and I am wondering what and how I should set it up in my incremental refresh setting. I am currently set the archive data starting 3 months from refresh date and incremental refresh 20 days - which will imported my data from 01/01/2023. But by doing it I have to constantly going back to change the setting and refreshing it - this may take up a lot of time everytime I change the setting. I was wondering is there a way we can set a specific start date for import data and they will do the incremental refresh starting from that specific date, in my example is 01/01/2023. Thank you in advance.864Views0likes1CommentIncremental load failure
Not sure this is the right area for this, please let me know. I was curious about data load errors when performing an incremental load. For instance, if you are doing daily loads, and it fails over the weekend, on monday after its fixed it will be missing saturday and subdays load, right? Do you have to reset it up again or is there something else you can do? ThanksSolved1.3KViews0likes4CommentsMeasures different in published report compared to desktop
Some measures seem to be calculating things differently in the published version of a report I have compared to what is appearing locally on desktop. The measures in the desktop version: 22.187%, -1.8350%, 22.594%. The measures in the published report are closer to 14%, -273%, and 54%. The data comes from sql server, which is then unpivoted in Power BI, and the measures are created based on the unpivoted data. Everything seems fine in Desktop, but in the published version I'm seeing very different numbers. Even weirder is I've tried to publish the report a few times and the measure will initially appear correct in the published version and then a few mintues later switch to being incorrect. Any ideas?2KViews1like4CommentsError on Incremental Update
Hi Guys! I found one way to use incremental refresh using .xlsx files and I was able to do all the steps to cofigure it on PBI Desktop, but, when I went to service to update using the gateway I got this error: Can someone, please, help me to understand this error? Erro de fonte de dados: {"error":{"code":"DM_GWPipeline_Gateway_MashupDataAccessError","pbi.error":{"code":"DM_GWPipeline_Gateway_MashupDataAccessError","parameters":{},"details":[{"code":"DM_ErrorDetailNameCode_UnderlyingErrorCode","detail":{"type":1,"value":"-2147467259"}},{"code":"DM_ErrorDetailNameCode_UnderlyingErrorMessage","detail":{"type":1,"value":"A coluna 'Date' da tabela não foi encontrada."}},{"code":"DM_ErrorDetailNameCode_UnderlyingHResult","detail":{"type":1,"value":"-2147467259"}},{"code":"Microsoft.Data.Mashup.ValueError.Detail","detail":{"type":1,"value":"Date"}},{"code":"Microsoft.Data.Mashup.ValueError.Reason","detail":{"type":1,"value":"Expression.Error"}}],"exceptionCulprit":1}}}Solved1.4KViews0likes3Commentsincremental refresh with Web.Contents not working
I have prepared a PBI M query using Web.Contents with RangeStart and RangeEnd parameters as described here which works fine in PBI desktop, but produces apparently unrelated errors in PBI Service (with or without gateway). Has anybody gotten something similar to work? This is the Source statement: Source = Json.Document(Web.Contents( "https://somehost.net/analytics/api/v1/order", [ Query=[ updated_after=DateTimeZone.ToText(DateTimeZone.From(RangeStart), "yyyy-MM-ddThh:mm:sszzz"), updated_before=DateTimeZone.ToText(DateTimeZone.From(RangeEnd), "yyyy-MM-ddThh:mm:sszzz") ]])) Thanks, JohanSolved8.1KViews0likes13CommentsIssue refreshing with incremental refreshing
Hi community. I'm having an issue when I try to refresh my report. I've configurate incremental refresh with 2 differents tables. When I apply to one of them, (it's a very simple table), wverithing is ok. But when I try to apply to the second one, which is a little bit more complicated, having been modified in Power Query, then it fails. The error message is as follows: There was an error when processing the data in the dataset. Please try again later or contact support. If you contact support, please provide these details. Data source error{"error":{"code":"DM_GWPipeline_Gateway_MashupDataAccessError","pbi.error":{"code":"DM_GWPipeline_Gateway_MashupDataAccessError","parameters":{},"details":[{"code":"DM_ErrorDetailNameCode_UnderlyingErrorCode","detail":{"type":1,"value":"-2147467259"}},{"code":"DM_ErrorDetailNameCode_UnderlyingErrorMessage","detail":{"type":1,"value":"Erro durante a avaliação."}},{"code":"DM_ErrorDetailNameCode_UnderlyingHResult","detail":{"type":1,"value":"-2147467259"}}],"exceptionCulprit":1}}} Cluster URIWABI-EUROPE-NORTH-B-redirect.analysis.windows.net Activity ID3f16c325-22fb-4dd1-9b45-cbde1e8266e7 Request ID433f383a-fd9c-7522-67cc-0229ab5acd6d Time2020-11-05 19:03:56Z I don't know where is the problem. When I go to settings and see parameters, it seems like it doesn't recognized what I've configured in Desktop version. Any idea what could be happening? Thanks in advance906Views0likes1Comment