Forum Discussion
Project doubles in size when creating dimension tables
I have one large data set (300MB about 700k rows). I would like to make a series of dimension tables to reduce the size. My process has been to duplicate the original query, remove the columns I ...
Hi Anonymous
From which source are you getting your data from? Can you write an SQL query just to bring in the columns you need?
I would also do the following
- Remove any unnecessary columns from your Fact table before duplicating.
- Convert any DateTime columns to Date if you don't need the time. If you Do create a separate column for time.
- Do you have a Date table in your model? (see my Bio) If yes turn off Auto date/time for new files in both sections of the settings
- There isalso something I came across recently, you will need to install tabular editor, but it can reduce the size by a few hundred MBs. https://datamozart.substack.com/p/hidden-little-gem-that-can-save-your
Hope this helps
Joe
I don't have access to SQL on my work computer but that could be an option. Thanks for your response. I didn't realize that the duplication would still be a large file after I removed the columns I didn't need.