Forum Discussion

akkibuddy7's avatar
akkibuddy7
Helper I
1 year ago
Solved

Incremental refresh For S3 shortcut

I have parquet Partitioned data in S3 and using shortcut it only pulls the files not table and to solve this I'm using Notebook to convert that into delta tables in lakehouse. But S3 data gets refres...
data engineering
lakehouse
  • spark123's avatar
    spark123
    1 year ago

    If you are trying to run the notebook without a pipeline use schedule from inside the notebook 

     

Anonymous's avatar
Anonymous
Not applicable
1 year ago

Hi akkibuddy7,

Thanks for reaching out to the Microsoft fabric community forum.

 

It looks like you have partitioned Parquet data in Amazon S3, and you're trying to bring this data into a Fabric Lakehouse. Please go through the solution provided by spencer_sa and if it solves your issue please accept it as solution.

 

I would also take a moment to thank spencer_sa., for actively participating in the community forum and for the solutions you’ve been sharing in the community forum. Your contributions make a real difference.

 

If I misunderstand your needs or you still have problems on it, please feel free to let us know.  

Best Regards,
Hammad.
Community Support Team

 

If this post helps then please mark it as a solution, so that other members find it more quickly.

Thank you.