SAP BW Data Load & Performance

[abbas_uddin]

Dear Experts,

Need you suggestions on how to handle importing large datasets from SAP BW to Power BI. Most of time it times out, dividing the queries into parts is not a good solution everytime. Is it possible to create a Data layer on top of BW using any platform and then import data from the new source. So we can create huge reports and importing will not take time.

The data importing just takes forever if we want to import material level transactions etc. As we are a holding company, we have several requirements at group level for reporting as well as each company level.

What do you suggest, as we need to implement Power BI in each our companies for daily reporting and retire SAP BEX Reports. As well as do the reporting on Group level.

How can we have a data layer or data lake ready for import on top of BW so we can easily generate reports. Other solutions are also welcomed.

[v-alq-msft]

Hi, @abbas_uddin 

I'd like to suggest you try using incremental refresh in PowerBI. Incremental refresh enables very large datasets in Power BI with the following benefits:

• Refreshes are faster - Only data that has changed needs to be refreshed. For example, refresh only the last five days of a ten-year dataset.
• Refreshes are more reliable - It's no longer necessary to maintain long-running connections to volatile source systems.
• Resource consumption is reduced - Less data to refresh reduces overall consumption of memory and other resources.

For further information, please refer to the Incremental refresh in Power BI .

Best Regards

Allan

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[abbas_uddin]

@v-alq-msftThank you for your reply. Will this help if we have reports with input parameters?. Where user will request the data after parameters are set.

Since we are thinking to implement for each company under us and users will start using for their daily reporting instead of using BEX or ERP reports.