Forum Discussion
Changing string storage for DirectLake over OneLake
- 9 months ago
You are welcome jaryszek
By “reshape the data in OneLake,” I mean cleaning or restructuring your source tables before DirectLake reads them:Cut down very long or unique text columns (hash them or move them to a lookup).
Trim or split oversized fields.
Pre‑aggregate or filter data so fewer distinct values are loaded.
In short you need to adjust the Lakehouse tables so DirectLake doesn’t choke on huge text fields.
Did it work? 👍 A kudos would be appreciated
🟨 Mark it as a solution to help spread knowledge 💡
Hi jaryszek
The article you linked is correct for SQL Server Analysis Services and Azure Analysis Services models, where you can change StringStoresCompatibilityLevel to 1100 to lift the 4 GB string store limit, but this setting doesn’t apply to Fabric DirectLake datasets, DirectLake doesn’t use string stores in the same way, so you can’t change it in Tabular Editor or via XMLA.
If you’re hitting this error in DirectLake, the only real options I can suggest are to reshape the data in OneLake or switch the dataset to Import mode if you need those large text fields.
Did it work? 👍 A kudos would be appreciated
🟨 Mark it as a solution to help spread knowledge 💡
- jaryszek9 months agoSuper User
Thank you very much,
"to reshape the data in OneLake " what does you mean by that?
Best,
Jacek- DataVitalizer9 months agoSuper User
You are welcome jaryszek
By “reshape the data in OneLake,” I mean cleaning or restructuring your source tables before DirectLake reads them:Cut down very long or unique text columns (hash them or move them to a lookup).
Trim or split oversized fields.
Pre‑aggregate or filter data so fewer distinct values are loaded.
In short you need to adjust the Lakehouse tables so DirectLake doesn’t choke on huge text fields.
Did it work? 👍 A kudos would be appreciated
🟨 Mark it as a solution to help spread knowledge 💡- jaryszek9 months agoSuper User
thank you very much