Forum Discussion

sivanarayanan's avatar
sivanarayanan
New Member
9 months ago
Solved

AdlsGen2ForbiddenError on Fabric Data Warehouse staged copy for one large table (after ~1 hour)

The problem The copy activity runs for about 1–1:15 hours. After that, it fails with AdlsGen2ForbiddenError on a CreateFile operation to the staging path. Other tables using the same pipelin...
data engineering
data pipeline
lakehouse
  • sivanarayanan's avatar
    sivanarayanan
    8 months ago

    Hi wardy912 , nielsvdc 

    Thanks for your reply. 

    With my use cases,

    wardy912, I cannot have multiple copy data activities at the same time within the ForEach 
    nielsvdc As I use built-in enable staging, I am unable to use a service principal for authentication, and splitting the copy activity into smaller batches will not work for me. 

    I solved the issue by using external storage instead of workspace storage. 

sivanarayanan's avatar
sivanarayanan
New Member
8 months ago

Hi wardy912 , nielsvdc 

Thanks for your reply. 

With my use cases,

wardy912, I cannot have multiple copy data activities at the same time within the ForEach 
nielsvdc As I use built-in enable staging, I am unable to use a service principal for authentication, and splitting the copy activity into smaller batches will not work for me. 

I solved the issue by using external storage instead of workspace storage. 

V-yubandi-msft's avatar
V-yubandi-msft
Icon for Community Support rankCommunity Support
8 months ago

Thank you for the update. Glad to know the issue is clear now. Thanks for sharing.