Forum Discussion
Copy activity UTC/local time zone conversion problem from On Prem Gateway
Hi,
i cant solve time zone issues, maybe on prem gateway should have some settings or what i should do?
1. Data source is On Prem SQL, all date/time fields are stored in UTC time;
2. Our local time zone is +2;
3. Using copy activity to Lakehouse, all date/time fields are saved these -2 hours. Example, if it is only date (2024-05-22T00:00:00), then in Lakehouse table i have 2024-05-21T:22:00:00, and everything with time is just -2hours back... Until now i was using dataflows gen2, this issue was not ocurring...
22 Replies
- AnonymousNot applicable
Hi matkvaid ,
Thanks for using Fabric Community.
Can you please share the screenshots of your pipeline configuration? Also can you confirm that you did not faced this issue with dataflow gen 2 but observing with copy activity?- matkvaidHelper III
Hello,
is this enough? Preview is from on prem SQL source, so it has correct date/time (it does not have timezone in source). In Dataflows it was correct, i was testing them from start of Fabric trial and copy date to Warehouse. Now when On Prem gateway connection is possible in Pipelines, we started moving everything to Lakehouse with Pipelines. Attaching screenshot:
- matkvaidHelper III
Oh and i forgot to mention - in bottom of picture, is screenshot from destination lakehouse table
- matkvaidHelper III
Any news from Microsoft on this issue? I was told by support team, that it is a known bug and fix should have been released yesterday?
- MarkBurgessAdvocate I
I'm also eagerly awaiting a fix for this.
Anonymous is there an ETA for the fix? Is it worth me raising my own ticket if it is already a known issue?
Thanks
- AnonymousNot applicable
Hi MarkBurgess , matkvaid
Thanks for using Fabric Community.
At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.
- datafabricatorFrequent Visitor
Just wanted to say that our team also just tore our hair over this. Found out here that it's a bug.
It's critical to say the least, since it affects incremental loads. Please prioritize it!
- matkvaidHelper III
I agree, it affects many things: incremental loads, data in reports... 🙂 It shifts datetime2 columns that have date only, and time is T00:00:00 to - 1 day 😄 I found posts that are more than a month old, and it was also commented that it is a bug. On premise data gateway support for pipelines was released end of March, i believe that it was noticed qute soon. Two months and no fix, no solutions for temporary workarounds - nothing. I understand that we are on Trial, so we can help develop and fix bugs for free, but the trial will end for me, and with current situation i cannot imagine paying for capacity... 😄
- matkvaidHelper III
Still no information about this?? How is this even possible, did Microsoft decided just to ignore it? Support also does not answer.
- Rk_1411Frequent Visitor
Any update on this.. It seems to be a known bug with no solution.
- matkvaidHelper III
It seems that this bug is fixed, for the last week or two i do not have this problem anymore. Althoug communication about that from Microsoft side is "awesome"... I asked support about it, i had a ticket - wasted my time once again for nothing... 🙂
- Rk_1411Frequent Visitor
It is resolved for me. I updated the On pren data gateway to the latest version July 2024 and that seems to fix the issue.