Forum Discussion

vkesche's avatar
vkesche
New Member
6 years ago

10 GB limit

it works well when there are 3m pieces of data,

when there are 10m pieces of data, it will report an error.

The amount of uncompressed data on the gateway client has exceeded the 10 GB limit for a single table,

how to deal with it?

Need Help
Tips and Tricks

1 Reply

  • AnkitBI's avatar
    AnkitBI
    Solution Sage
    6 years ago

    Hi vkesche 

     

    10 GB uncompressed is  a known issue with Data Refresh. To permanently get rid of the issue, the only option is to move to Premium capacity. You can also try below methods that will be helpful.

     

    • Only Extract columns from source that are requried. Reduce the Rows also if possible.
    • In case you are using Database, change the data type of Columns to lower memory ones.
    • Use LookUp tables and In Facts use LookUp keys instead of complete strings.
    • Move your calculated columns from PQ to DAX as DAX columns are not included in 10GB limit. 
    • If source permits, change from Import to Direct Query

     

    Thanks
    Ankit Jain
    Do Mark it as solution if the response resolved your problem. Do Kudo the response if it seems good and helpful.