Forum Discussion
Working with big database
To reduce your file size, you can do the following:
1. In query editor, right click on the queries that are appended and uncheck Enable Load, so you don't load your data twice. They will still be refreshed but not loaded. Also get rid of any columns and rows you don't need, especially columns with high granularity.
2. If available, you can set up incremental refresh to reduce refresh time significantly.
If this works for you, please mark it as solution. Kudos are appreciated too. Please let me know if not.
Regards,
Pat
To reduce your file size, you can do the following:
1. In query editor, right click on the queries that are appended and uncheck Enable Load, so you don't load your data twice. They will still be refreshed but not loaded. Also get rid of any columns and rows you don't need, especially columns with high granularity.
2. If available, you can set up incremental refresh to reduce refresh time significantly.
If this works for you, please mark it as solution. Kudos are appreciated too. Please let me know if not.
Regards,
Pat
Hello mahoneypat ,
Thank you for replying, regarding 1), it is a good advice as it can help me to reduce the update/refresh time but I am interested also in reducing the size of the document. Do you have any advice on how I can work with three different tables (2018 to 2020) in a way I can reduce document size?
As I mentioned in my post, I appended the three tables but I have to keep the original separated tables because I guess that if I delete the original tables, it will affect the appended table.
2) How can I use incremental refresh? will that help me to update only the last month of 2020?
That's the nice thing about unchecking Enable Load, it still refreshes the data when you hit refresh but it isn't loaded in your model. You don't need to load them. The appended table will be the same.
That should get you a big reduction (half + I'm guessing). After that, get rid of as many columns as you can (and rows of course, if possible). See this video on incremental refresh with pro licenses - https://www.youtube.com/watch?v=-pjmKI66iRQ
If you have premium, it is even easier.
If this works for you, please mark it as solution. Kudos are appreciated too. Please let me know if not.
Regards,
Pat
