Forum Discussion
Dataflow gen2 using variables from Variable Libraries Failing
Hello TLibson,
I will check the variable queries first. For those queries, are staging and output disabled?One thing worth checking is staging on the variable queries. Microsoft suggests turning this setting off when you’re using Variable.ValueOrDefault().
Another choice is to compare the Workspace and Lakehouse IDs in your variables with the ones returned by Lakehouse.Contents(). If they are not matching, then that mismatch might be the reason you are getting the key error.
Check the GUID casing too.
If those match, I will then look at the destination query and table navigation.
Microsoft docs: Variable references in a Dataflow
I turned off staging on my variable queries and that cleared up the errors with loading the variables.
I realized I was also having some mismatch issues with fixed schema tables. I took over ownership on some previously written dataflows and I believe the data destination was configured to an existing table instead of a new table with a dynamic schema. I just needed to delete the table in the lakehouse, and then set the data destination to create a new table.
I would say that as of now my issue is fixed.
Thank you for your help