Create a table shortcut to CSV folder using DDL 'Create Table' stopped working

[kobia10]

For the last few months we ran a statement in a notebook to create a table under the tables folder

The table was created correctly and we could run pySpark code against the table

Very recently, after executing the statement we get table created with a red X sign to its right. Cannot see the fields. Pressing on the X shows an error that the target table cannot be reached. 

However, I can view the data against that table from a cell using pySpark

CREATE EXTERNAL TABLE IF NOT EXISTS `msdyn_facility` (

`Id` STRING,

`SinkCreatedOn` TIMESTAMP,

`SinkModifiedOn` TIMESTAMP,

`statecode` INTEGER,

`statuscode` INTEGER,

`msdyn_approvalstatus` INTEGER,

`msdyn_waterriskindex` STRING,

`msdyn_waterriskindex_entitytype` STRING,

`modifiedonbehalfby` STRING,

`modifiedonbehalfby_entitytype` STRING,

`owninguser` STRING,

`owninguser_entitytype` STRING,

`createdonbehalfby` STRING,

`createdonbehalfby_entitytype` STRING,

`msdyn_dataconnectionrefresh` STRING,

`msdyn_dataconnectionrefresh_entitytype` STRING,

`owningbusinessunit` STRING,

`owningbusinessunit_entitytype` STRING,

`owningteam` STRING,

`owningteam_entitytype` STRING,

`modifiedby` STRING,

`modifiedby_entitytype` STRING,

`createdby` STRING,

`createdby_entitytype` STRING,

`msdyn_facilitytype` STRING,

`msdyn_facilitytype_entitytype` STRING,

`msdyn_dataconnection` STRING,

`msdyn_dataconnection_entitytype` STRING,

`msdyn_waterbasin` STRING,

`msdyn_waterbasin_entitytype` STRING,

`ownerid` STRING,

`ownerid_entitytype` STRING,

`createdonbehalfbyyominame` STRING,

`msdyn_addresscountryisocode` STRING,

`owneridname` STRING,

`msdyn_facilityid` STRING,

`msdyn_addresscounty` STRING,

`msdyn_name` STRING,

`msdyn_addresscity` STRING,

`msdyn_waterriskindexname` STRING,

`importsequencenumber` INTEGER,

`msdyn_dataconnectionname` STRING,

`modifiedbyyominame` STRING,

`msdyn_longitude` DECIMAL(38,10),

`msdyn_addressstateprovince` STRING,

`msdyn_addresszippostalcode` STRING,

`msdyn_facilitytypename` STRING,

`utcconversiontimezonecode` INTEGER,

`createdbyyominame` STRING,

`msdyn_latitude` DECIMAL(38,10),

`modifiedbyname` STRING,

`timezoneruleversionnumber` INTEGER,

`owneridtype` STRING,

`msdyn_addressstreet1` STRING,

`owneridyominame` STRING,

`modifiedon` TIMESTAMP,

`msdyn_origincorrelationid` STRING,

`modifiedonbehalfbyyominame` STRING,

`createdbyname` STRING,

`createdon` TIMESTAMP,

`msdyn_dataconnectionrefreshname` STRING,

`owningbusinessunitname` STRING,

`createdonbehalfbyname` STRING,

`modifiedonbehalfbyname` STRING,

`msdyn_waterbasinname` STRING,

`versionnumber` INTEGER,

`msdyn_addressstreet2` STRING,

`overriddencreatedon` TIMESTAMP)

USING CSV

OPTIONS (

`multiLine` 'true',

`ignoreLeadingWhiteSpace` 'true',

`quote` '"',

`timestampFormat` 'M/dd/yyyy hh:mm:ss a',

`ignoreTrailingWhiteSpace` 'true',`escape` '"')

LOCATION 'Files/dv/msdyn_facility/*.csv'

TBLPROPERTIES (

'sql:IsAppendOnly' = 'true');

[vanessafvg]

has the schema changed at all?

this post might offer a solution

https://community.fabric.microsoft.com/t5/Service/Lakehouse-table-schema-not-updating-at-dataflow-re...

in that you might need to update metadata?

[kobia10]

No. The table is a new one.

Used to work before without any issues. Not clear when the change in Fabric has occured.

As I said i can use pySpark to query the table in a notebook. Just the Lakehouse UI seems to be broken

This works and returns data...

df = spark.sql("SELECT * FROM Sust.msdyn_facility LIMIT 1000")

display(df)

See below the error saying 'The requested file cannot be found' relating to the shortcut that returns data

[v-gchenna-msft]

Hi @kobia10 ,

Thanks for using Fabric Community.
I would like to understand, what changes you made recently?
When did you started observing this issue?
Are you able to load the table in Notebooks? Sql Endpoint?

I can guide you, if you can share these details. 

[kobia10]

No changes made

Start seeing these last week. However, I have not visited the scenario for a while

I can load the data using spark.sql('select * from lakehouse.tablename")

[v-gchenna-msft]

Hello @kobia10 ,

At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.

[v-gchenna-msft]

Hi @kobia10 ,

Apologize for the issue you are facing. The best course of action is to open a support ticket and have our support team take a closer look at it.

Please reach out to our support team so they can do a more thorough investigation on why this it is happening: Link 

After creating a Support ticket please provide the ticket number as it would help us to track for more information.

Hope this helps. Please let us know if you have any other queries.

[v-gchenna-msft]

Hi @kobia10 ,

We haven’t heard from you on the last response and was just checking back to see if you got a chance create a support ticket.
After creating a Support ticket please provide the ticket number as it would help us to track for more information.

Thanks

[v-gchenna-msft]

Hi @kobia10 ,

Thank you for sharing it internally. Hope you would be able to get some solution from the team.

Please share in Fabric Community if you are able to get to a resolution.