Forum Discussion
Post ProdigyHELP! Can't see uniqueidentifier fields in DirectLake semantic model
Hi arpost ,
Thanks for the detailed response!I am happy to help you.
Since there is a known limitation where Spark used in DirectLake cannot read UNIQUEIDENTIFIER columns from Delta tables created by the Data Warehouse.Microsoft team is actively working to fix the issue.Mean time I highly recommend sharing this feedback on the Fabric Ideas portal.Feedback submitted through these channels is frequently reviewed by the product teams and can contribute to meaningful improvements.
https://ideas.fabric.microsoft.com/ideas/search-ideas/Hope this helps.If so,consider accepting it as solution.
Post ProdigyThanks for the reply, Anonymous, and appreciate the workaround. I'm not looking forward to having to double-store data as I want values in UID format within the DW itself. Is there any status from Microsoft or feature in the works that will fix/change this?
I see this as a fairly significant limitation as it leaves us with only a few options; none of the above are ideal in my estimation:
| Scenario | Comment |
Use an integer with the "hacky" primary key generation approach of MAX(Key) + 1 | Not feasible when running numerous concurrent write operations to the same table as this will produce duplicates. Adds orchestration overhead. |
| Store primary keys as strings | |
| Use UID for PK and double-store UID as text | Adds to storage costs (albeit not a ton); adds complexity and inconsistent approaches to data (e.g., in this system we use this field but in THIS system we use that field). |
Hi arpost ,
Thanks for the detailed response!I am happy to help you.
Since there is a known limitation where Spark used in DirectLake cannot read UNIQUEIDENTIFIER columns from Delta tables created by the Data Warehouse.Microsoft team is actively working to fix the issue.Mean time I highly recommend sharing this feedback on the Fabric Ideas portal.Feedback submitted through these channels is frequently reviewed by the product teams and can contribute to meaningful improvements.
https://ideas.fabric.microsoft.com/ideas/search-ideas/
Hope this helps.If so,consider accepting it as solution.