Forum Discussion

Kevin8's avatar
Kevin8
Frequent Visitor
4 months ago
Solved

Problems with importing data from AWS Redshift

Hi everyone,   I have a Power BI Report called stored in a Power BI Workspace within my work organsiation. It is set to refresh weekly on Monday mornings. The refresh fails and the reason for th...
Need Help
  • tayloramy's avatar
    tayloramy
    4 months ago

    Hi Kevin8, 

     

    Switching to large semantic model storage might help. 

    Is your 11m row fact table a full load on refresh or is it incremental? If it is a full load, you may want to look at making it incremental.  

tayloramy's avatar
tayloramy
Super User
4 months ago

Hi Kevin8, 

 

It's not the filesize of the pbix file that is the problem here, it's how much the data expands during refresh.  

For an F64 capacity, the max memory available is 25GB, which is the limit you're hitting. 

 

Can you describe more about what data sources you're using and what sort of transformations are being done?

Kevin8's avatar
Kevin8
Frequent Visitor
4 months ago

Hi,
There are 29 queries. Its a star schema with one large fact table and many small dimension tables. The dmiension tables might have some power query steps such as columns removed or renamed. Or a key column added. Several of these have 5 - 10 rows. The largest has 9 columns and 750k rows , the next largest has 4 columns and 500k rows. The next has 5 columsn and 26k rows.

The main fact table has 88 columns and 11.5 m rows.  It has a renamed columns step, and an append query where it adds an 88 row table.