Forum Discussion

matkvaid's avatar
matkvaid
Helper III
2 years ago

Copy activity UTC/local time zone conversion problem from On Prem Gateway

Hi,

 

i cant solve time zone issues, maybe on prem gateway should have some settings or what i should do?

 

1. Data source is On Prem SQL, all date/time fields are stored in UTC time;

2. Our local time zone is +2;

3. Using copy activity to Lakehouse, all date/time fields are saved these -2 hours. Example, if it is only date (2024-05-22T00:00:00), then in Lakehouse table i have 2024-05-21T:22:00:00, and everything with time is just -2hours back... Until now i was using dataflows gen2, this issue was not ocurring...

22 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi matkvaid ,

    Thanks for using Fabric Community.
    Can you please share the screenshots of your pipeline configuration? Also can you confirm that you did not faced this issue with dataflow gen 2 but observing with copy activity?

    • matkvaid's avatar
      matkvaid
      Helper III

      Hello, 

      is this enough? Preview is from on prem SQL source, so it has correct date/time (it does not have timezone in source). In Dataflows it was correct, i was testing them from start of Fabric trial and copy date to Warehouse. Now when On Prem gateway connection is possible in Pipelines, we started moving everything to Lakehouse with Pipelines. Attaching screenshot:

       

       

      • matkvaid's avatar
        matkvaid
        Helper III

        Oh and i forgot to mention - in bottom of picture, is screenshot from destination lakehouse table

  • Any news from Microsoft on this issue? I was told by support team, that it is a known bug and fix should have been released yesterday? 

    • MarkBurgess's avatar
      MarkBurgess
      Advocate I

      I'm also eagerly awaiting a fix for this.

      Anonymous is there an ETA for the fix? Is it worth me raising my own ticket if it is already a known issue?

      Thanks

       

      • Anonymous's avatar
        Anonymous
        Not applicable

        Hi MarkBurgess , matkvaid 


        Thanks for using Fabric Community.
        At this time, we are reaching out to the internal team to get some help on this .
        We will update you once we hear back from them.

  • Just wanted to say that our team also just tore our hair over this. Found out here that it's a bug.

    It's critical to say the least, since it affects incremental loads. Please prioritize it!

    • matkvaid's avatar
      matkvaid
      Helper III

      I agree, it affects many things: incremental loads, data in reports... 🙂 It shifts datetime2 columns that have date only, and time is T00:00:00 to - 1 day 😄 I found posts that are more than a month old, and it was also commented that it is a bug. On premise data gateway support for pipelines was released end of March, i believe that it was noticed qute soon. Two months and no fix, no solutions for temporary workarounds - nothing. I understand that we are on Trial, so we can help develop and fix bugs for free, but the trial will end for me, and with current situation i cannot imagine paying for capacity... 😄

  • Still no information about this?? How is this even possible, did Microsoft decided just to ignore it? Support also does not answer.

  • Rk_1411's avatar
    Rk_1411
    Frequent Visitor

    Any update on this.. It seems to be a known bug with no solution.

    • matkvaid's avatar
      matkvaid
      Helper III

      It seems that this bug is fixed, for the last week or two i do not have this problem anymore. Althoug communication about that from Microsoft side is "awesome"... I asked support about it, i had a ticket - wasted my time once again for nothing... 🙂

      • Rk_1411's avatar
        Rk_1411
        Frequent Visitor

        It is resolved for me. I updated the On pren data gateway to the latest version July 2024 and that seems to fix the issue.