Shortcuts to ADLSGen2 Delta/Parquet files not recognized as tables

[charrington]

Hi
I was able to create some shortcuts from Lakehouse to ADLSGen2 delta parquet files, but strangely I cannot anymore.

I get this error:

I put the path to the folder containing the parquet files which is delta parquet, but the shortcut falls under "undefined" folder so it sees it only as files not table.
As you can see in my screenshot, at least one shortcut is identified as table. But even when trying to recreate this one, it now falls under "undefined".

 
Have you encountered this behavior? I tried different folders for different tables, same result.

[charrington · Accepted solution]

Hi
just sharing some more info, I think there is some bugs here around these shortcuts.

After my unsuccessful attempts yesterday, you always think, ok let's give it another try, I must be doing something wrong. So I went ahead and created a new Dataflow/Pipeline sinking into ADSLGen2 (I am working in Synapse), the same exact way I did for other tables. Then created a shortcut in Fabric. Guess what? It worked! 😁

But if you're like me you're kind of feeling mixed emotions here. It worked but you don't know what happened exactly. 🙄

Another thing I realized, it that even if these shortcuts fall under "undefined" in the Lakehouse, when I switch the the SQL endpoint...guess what? the shortcuts are being seen as tables. 😶

So the same shortcut seen as "undefined" in the Lakehouse view now works perfectly in the SQL endpoint view:

And it's accessible also from the Warehouse, you can create a view with it, etc.

Then in conclusion it works. It's just the display in the Lakehouse that is really confusing, cause some tables are seen as "undefined" and some other as trues tables, but the SQL endpoint shows a better view of what's available.

Thanks for reading! If you find anything regarding this topic please share. 😎

[charrington · Accepted solution]

Hi
just sharing some more info, I think there is some bugs here around these shortcuts.

After my unsuccessful attempts yesterday, you always think, ok let's give it another try, I must be doing something wrong. So I went ahead and created a new Dataflow/Pipeline sinking into ADSLGen2 (I am working in Synapse), the same exact way I did for other tables. Then created a shortcut in Fabric. Guess what? It worked! 😁

But if you're like me you're kind of feeling mixed emotions here. It worked but you don't know what happened exactly. 🙄

Another thing I realized, it that even if these shortcuts fall under "undefined" in the Lakehouse, when I switch the the SQL endpoint...guess what? the shortcuts are being seen as tables. 😶

So the same shortcut seen as "undefined" in the Lakehouse view now works perfectly in the SQL endpoint view:

And it's accessible also from the Warehouse, you can create a view with it, etc.

Then in conclusion it works. It's just the display in the Lakehouse that is really confusing, cause some tables are seen as "undefined" and some other as trues tables, but the SQL endpoint shows a better view of what's available.

Thanks for reading! If you find anything regarding this topic please share. 😎

[Anonymous · Accepted solution]

Hi @charrington  - Welcome to Fabric Community and thanks for posting your question here.

As I understand you are trying to use shortcuts with parquet files.

We observed intermittent issue, when we worked with shortcuts with parquet files.

This intermittent issue is resolved now and I am able to create shortcut for parquet files.

Azure Data Lake Gen 2:


Fabric Lakehouse:

I hope this information helps you resolve the issue. Let me know if you have any further questions or concerns.

[Anonymous]

Hi @charrington ,

Glad to know that your query got resolved.

Please continue using Fabric Community for help regarding your issues.