Forum Discussion

manishkumar13's avatar
manishkumar13
Frequent Visitor
1 year ago
Solved

Urgent Help Needed: Automating File Transfer from SharePoint

Subject:  Urgent Help Needed: Automating File Transfer from SharePoint to Data Lakehouse Using Fabrics Hi everyone, I am trying to automate a process where a new file in a SharePoint folder, whic...
  • v-kpoloju-msft's avatar
    1 year ago

    Hi manishkumar13,
    Thanks for reaching out to the Microsoft Fabric Community Forum.

     

    After thoroughly reviewing the details you provided, here are a few alternative workarounds that might help resolve the issue. Please follow the steps below:

     

    • Ensure your connection to the SharePoint folder is correctly configured by checking the URL, credentials, and permissions. Confirm that the file is being updated daily. You can manually verify the file's presence and updates in the folder.
    • Make sure your notebook is set up to monitor the SharePoint folder using a loop or a scheduled task to periodically check for new files.
    • Double-check your Geneflow 2 settings. Ensure the source is set to the SharePoint folder and the destination is set to the Lakehouse, with the "append data" option selected.
    • Check the error logs for any issues during the file transfer. Look for specific error messages and validate that the data format and structure are consistent and compatible with the Lakehouse.
    • Ensure there are no network issues interrupting the file transfer. Verify your network connection and firewall settings.
    • Review the automation logs for any failures or issues, as they provide detailed information about each operation's status and any errors encountered.
    • Check for any throttling or connection limits imposed by SharePoint or the Lakehouse. Test the process with a smaller sample file to determine if the issue is related to file size or content.

    Please go through the below following links for more information:
    Options to get data into the Lakehouse - Microsoft Fabric | Microsoft Learn

    If this post helps, then please give us ‘Kudos’ and consider Accept it as a solution to help the other members find it more quickly.

     

    Best Regards.