Forum Discussion
Helper IIIDateTime timezone changes while copying to .parquet
Hi,
I think I figured out the problem. My source system doesn't have any timezone specification in their datetime fields. I've read that parquet self-assigns a timezone to the value if the source doesn't give any.
Since the Fabric capacity is probably in another timezone, it changes the default timezone of my .parquet files.
I've had to set the correct timezone in my spark notebook to correct this. More info on:
Microsoft EmployeeHi Noeleke1301
Thanks for using Microsoft Fabric Community.
At this time, we are reaching out to the internal team to get some help on this.
We will update you once we hear back from them.
Appreciate your patience.
Thanks
Noeleke1301Hi,
I think I figured out the problem. My source system doesn't have any timezone specification in their datetime fields. I've read that parquet self-assigns a timezone to the value if the source doesn't give any.
Since the Fabric capacity is probably in another timezone, it changes the default timezone of my .parquet files.
I've had to set the correct timezone in my spark notebook to correct this. More info on:
- v-cboorla-msft
Hi Noeleke1301
Glad that you were able to find some insights and thank you for sharing the same with the community as it can be helpful to others.
Please continue using Fabric Community for further queries.
Thanks