Forum Discussion
Dataflow gen2 ends in sucess but does not refresh the data on table with security policy
I have a lakehouse secured using a security policy that controls the access by the user email. When I run the dataflow gen2 to refresh the tables, it runs successfully but the data is not updated.
The dataflow is setup to replace the table. I have found even deleting the table in the lake house does not work until the policy is first removed. When I remove the policy and refresh the dataflow - it works just fine. Any suggestions on how to refresh my data while keeping the policy in place?
----SECURITY POLICY SQL USED
1 Reply
- AnonymousNot applicable
Hi PowerNewUser
You can troubleshoot the problem by following these steps:
- Ensure that the account or service principal running Dataflow Gen2 has the necessary permissions to write to the lake tables (even when a security policy is applied)
- You can try creating a policy that allows broader access to see if the problem is related to security policy stringency
The following document may help you:
Pattern to incrementally amass data with Dataflow Gen2 - Microsoft Fabric | Microsoft Learn
Data Factory Dataflow Gen2 limitations - Microsoft Fabric | Microsoft Learn
Best Regards,
Yulia XuIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
- Ensure that the account or service principal running Dataflow Gen2 has the necessary permissions to write to the lake tables (even when a security policy is applied)