Forum Discussion

Namrata_Das_CLR's avatar
Namrata_Das_CLR
Frequent Visitor
3 years ago

Pulling Big Data From MYSQL database

Hi,   I have a large data table stored in Mysql database and while pulling the same  i 'm getting query timeout error as IT admin has set query timeout for security reason which he can't change.  ...
Need Help
AjithPrasath's avatar
AjithPrasath
Resolver II
3 years ago

Hi Namrata_Das_CLR ,

 Yes you can pull the data on the smaller batches and append the tables to create the new table in which you can schedule incremental refresh. In this way, you can you can retrieve data in smaller periods, consolidate it into a single table in Power Query, and enable incremental refresh to keep the consolidated table up to date with new data. This helps overcome the query timeout limitation while efficiently managing the data retrieval and refresh process in Power BI.

 

Best Regards,

Ajith Prasath

 

If this post helps, then please consider Accept it as the solution and give kudos to help the other members find it more quickly.

 

Namrata_Das_CLR's avatar
Namrata_Das_CLR
Frequent Visitor
3 years ago

Hi @AjithPrasath, i tried your suggestion but the appended table is not supporting incremental refresh