Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Help Required with Data Loading from Data Lake Gen 2 into Power BI

Hi Team,
     I am currently working on a task to load data from our Data Lake Gen 2 into Power BI. The data lake is structured into 9 folders, each containing approximately 25 Parquet files. Each file holds close to 5 million records.

I have successfully established a connection and can view the preview data within the Power BI transformation page. However, when I attempt to save and apply the data by selecting “Close & Apply,” the process has been running for about 5 hours and still has not completed.

 

Data Source: Azure Data Lake Storage Gen 2
Data Volume: Approximately 100 million records
Tool: Power BI Desktop (Import Mode)

Thank you in advance for your support.

 

I would greatly appreciate any guidance or assistance in resolving this issue to expedite the data loading process.

 

Thanks,

Sampath.

Need Help

2 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi Anonymous ,

     

    This may have reached the import's maximum 1GB storage limit, causing it to not be able to do the job, please consider using direct query or turning on enable load to load the required data.

     

    Hope it helps!

     

    Best regards,
    Community Support Team_ Scott Chang

     

    If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi Anonymous ,
         I am havign PRO subscription so 10 GB maximum limit and not encountering any errors by memory. 

     

    Regards,

    Sampathkumar AKula.