FORMAT DATETIME Field spark sql notebook cell

Hi davemc69, 
Thank you for sharing this problem. 
You're encountering this issue because the FORMAT() function you're using is valid in T-SQL (SSMS) but not supported in Spark SQL, which is what Fabric notebooks are based on.

Why the error occurs

Spark SQL does not support the FORMAT function. Instead, it uses a different function called date_format for formatting datetime values. That’s why you're seeing an error like

scala.Predef$.$qmark$qmark$qmark ... functionExists ...

Which means, Spark saying "I don't recognize this function."

How to fix it

Replace FORMAT with date_format in your SQL cell.

As per your existing query

SELECT 
  COUNT(1) AS RecordCount, 
  date_format(DateTime2_Column, 'yyyy-MMM-dd') AS FormattedDateField
FROM 
  lakehouse.Schema.TableName
WHERE 
  DateTime2_Column >= TIMESTAMP('2024-01-01 00:00:00')
GROUP BY 
  date_format(DateTime2_Column, 'yyyy-MMM-dd')
ORDER BY 
  FormattedDateField DESC

This version is compatible with Fabric notebooks and will produce the same result you're expecting.

For your reference, you can also follow this link

https://spark.apache.org/docs/latest/sql-ref-functions.html#date_format

Let me know if this resolves your issue — and if helpful, please mark this as the solution to assist others facing the same challenge.
Thanks!
– Shashi Paul | Fabric Community Member