Help on Understanding Loading history Data

[Heena_9980400]

Hi Experts,

I am working on a project where it has 10 years of historical data and the reports are adhoc(for each table 1 report is created and there are no RLS, Dax, calculated columns, and RLS),

and now at the database level, the historical data is started loading its count is 240 million.

I have a Power bi pro license with a premium workspace.

My doubt is will the power bi will handle it after the history data load. Please help me with this and do the needful.

Best Regards,

K

[edhans]

Power BI Pro has a 1GB dataset size limit, which is usually a few million records tops. In a P1 premium space, that has a 3GB upload limit, and I question 240M records fiitting in that too, but depends on the data, width of the fact table, etc. It can grow larger than that, but you are limited to a 3GB publish. You'd need to use incremental refresh and manage the model in the service via the XMLA endpoint to do that.

A P2 or larger premium capacity should be no problem no matter how you do it. With 240M records, I'd still look at incremental refresh so the last 9 years are loaded one time and never again, with the current year or even last few months being the only thing that is refreshed on a recurring basis.

[Heena_9980400]

Hi @edhans,

Thanks for the response,

The project will be retiring in the upcoming month in that case incremental refresh is not required rit?

and will pro and premium workspace be enough for that, Please give me your inputs?

Best Regards,

H

[edhans · Accepted solution]

Correct. IR would be good for long term. For short term, I'd probably skip it too. You will need a Premium workspace, probably P2 or larger, or a PPU workspace. A Pro license would be required to post to the former, a PPU license to the latter. A PPU workspace allows 100GB, so plenty big.