Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified as a Fabric Data Engineer: Check your eligibility for a 50% exam voucher offer and join us for free live learning sessions to get prepared for Exam DP-700. Get started

Reply
y0m0
Frequent Visitor

There are null values present in the column which was specified as 'not null'.

Hi I am getting a weird error when trying to run some simple select SQL queries against a lakehouse table.

It shows unable to preview data

y0m0_0-1701166114058.png

 

and if I explicitly run a select * query

 

y0m0_1-1701166171026.png

 

I get this error:
There are null values present in the column which was specified as 'not null'.

 

But I know that's not true.

Here is the table definition from my Notebook.

y0m0_2-1701166299545.png

 

The column causing trouble is _processedAt

If i run the select * query from a Notebook it works as expected.

 

y0m0_3-1701166408464.png

and if I check for NULL values it doesn't return any rows as expected.

 

y0m0_4-1701166481499.png

 

I experimented with changing the table definition and removing the NOT NULL constraint from the _processedAt column and the error disappear. But this is not a proper solution because I want to keep the constraint.

I suspect it's an issue on how the timestamp data type is converted to datetime2 in the SQL Analytics endpoint as stated here:
https://learn.microsoft.com/en-us/fabric/data-warehouse/data-types#autogenerated-data-types-in-the-s...

8 REPLIES 8
Hello-Im-Aaron
Frequent Visitor

Hi @y0m0. I am running into the same issue with my timestamps. Works find in notebooks but fails in the warehouse and as a consequence dfg2's. Were you able to find a workaround?

@Hello-Im-Aaronmy workaround was to remove the NOT NULL constraint from the timestamp columns in the CREATE TABLE query.
It's not ideal, but I have control over the pipeline so it's not a big issue.

@y0m0 it was fixed for me in the last day or two. Hopefully for you as well

Thanks. I've had a ticket open since Friday. I'll let you know what happens

v-nikhilan-msft
Community Support
Community Support

Hi @y0m0 
Thanks for using Fabric Community and reporting this. Apologies for the issue you have been facing.
At this time, we are reaching out to the internal team to get some help on this. We will update you once we hear back from them.
Appreciate your patience.
Thanks.

Hi @y0m0 

Apologies for the issue you have been facing. 

I would request you to please go ahead with Microsoft support for this. Please raise a support ticket on this link: https://support.fabric.microsoft.com/en-US/support/.

Also once you have opened the support ticket , please do share the supportcase# here. 

Thanks

Hi @y0m0 
We haven’t heard from you on the last response and was just checking back to see if you got a chance to create a support ticket. If yes please do share the ticket number here.
Otherwise, will respond back with the more details and we will try to help.
Thanks

Hi @y0m0 
We haven’t heard from you on the last response and was just checking back to see if you got a chance to create a support ticket. If yes please do share the ticket number here.
Otherwise, will respond back with the more details and we will try to help.
Thanks

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Prices go up Feb. 11th.

Feb2025 Sticker Challenge

Join our Community Sticker Challenge 2025

If you love stickers, then you will definitely want to check out our Community Sticker Challenge!

JanFabricDE_carousel

Fabric Monthly Update - January 2025

Explore the power of Python Notebooks in Fabric!

JanFabricDW_carousel

Fabric Monthly Update - January 2025

Unlock the latest Fabric Data Warehouse upgrades!