Forum Discussion
Copilot Context Issue in Fabric Notebook
Hi all, In Fabric, I'm trying to use Copilot in a Notebook. I have a DataFrame df that I created by reading a table from my lakehouse. When I try to run the following code asking Copilot to summa...
RESOLVED
The issue was that the Lakehouse I was loading a table from had too many tables (only 20 tables, each with ~100,000 rows).
For anyone else encountering this issue, try:
- Creating a new larger Spark pool (they're currently medium by default, x-large fixed my issue). See your Workspace settings.
- Reducing the size of your Lakehouse by deleting tables (not an option for my case)
- Creating a new Lakehouse to reference with the table you're trying to load (worked for me when my new Lakehouse was in a different Workspace)
Actually it's not just %describe that's having the issue, I'm getting the same error if I try:
%%chat
Analyze the data in dfRuntimeError: StructuredContext.optimize() was called with a mandatory context that was too large to fit in the max_prompt_tokens limit. The mandatory context was 3649 tokens, but the limit was 3346 tokens.
Check this video Microsoft Fabric Notebook Copilot Tutorial - YouTube although it stops just short of the %%describe example.