Forum Discussion
Helper IIIDateTime timezone changes while copying to .parquet
Hi,
I think I figured out the problem. My source system doesn't have any timezone specification in their datetime fields. I've read that parquet self-assigns a timezone to the value if the source doesn't give any.
Since the Fabric capacity is probably in another timezone, it changes the default timezone of my .parquet files.
I've had to set the correct timezone in my spark notebook to correct this. More info on:
Helper IIIHi,
I think I figured out the problem. My source system doesn't have any timezone specification in their datetime fields. I've read that parquet self-assigns a timezone to the value if the source doesn't give any.
Since the Fabric capacity is probably in another timezone, it changes the default timezone of my .parquet files.
I've had to set the correct timezone in my spark notebook to correct this. More info on:
Microsoft EmployeeHi Noeleke1301
Glad that you were able to find some insights and thank you for sharing the same with the community as it can be helpful to others.
Please continue using Fabric Community for further queries.
Thanks