Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago
Solved

MashupException.Error while trying to load incremental data by DateTime field

I am currently trying to follow the suggested approach here: https://learn.microsoft.com/en-us/fabric/data-factory/tutorial-setup-incremental-refresh-with-dataflows-gen2    I did an intial load to ...
Dataflows
Need Help
  • LuitwielerMSFT's avatar
    LuitwielerMSFT
    2 years ago

    Hey there! I am the PM that wrote the guide on how to do this. This is a great way to amass your data incrementally and using the date field makes sense! 

     

    What I noticed is that you still have the first query that retrieves the timestamp with staging enabled. Can you try to disable the staging on the query that retrieves the timestamp? 

     

     

    additionally I noticed you used the the first row from the output as getting the latest timestamp. Could you consider using this function instead? It is a bit simpler and cleaner. 

     

     

     

     

LuitwielerMSFT's avatar
LuitwielerMSFT
Microsoft Employee
2 years ago

Hey there! I am the PM that wrote the guide on how to do this. This is a great way to amass your data incrementally and using the date field makes sense! 

 

What I noticed is that you still have the first query that retrieves the timestamp with staging enabled. Can you try to disable the staging on the query that retrieves the timestamp? 

 

 

additionally I noticed you used the the first row from the output as getting the latest timestamp. Could you consider using this function instead? It is a bit simpler and cleaner.