Forum Discussion
Data Model Size - Import from Oracle DB vs. Data Flow
- 1 year ago
Hi Dave1mo1
I'm going to make an assumption that when you're. From Oracle it is changing the data types and it is these data types of all your model. To increase in size make sure that you use the correct data tab such as whole numbers. Instead of decimal numbers etc.
What you could also do is to compare your existing semantic model to new your new semantic model using the ALM toolkit and see the differences there.
- 1 year ago
Hi Dave1mo1 ,
Adding to GilbertQ response, the increase in model size when moving from SharePoint CSVs to Oracle views is probably due to differences in data types and compression. Oracle often uses DECIMAL, FLOAT, or wide VARCHAR fields, which typically don't compress as efficiently as the simpler structure of CSVs.
High cardinality columns like timestamps or IDs can also increase memory usage. Additionally, CSVs might have pre filtered data, while Oracle views could include more raw data.
Query folding may also play a role. Although Oracle supports folding, it only works if your Power Query steps are compatible. More complex views with joins or custom logic can break folding and cause full data loads. consider working with your database team to simplify views, use efficient data types, and filter data at the source. If the dataset is still over 1 GB, Power BI Premium Per User might be necessary.
Thanks for you prompt response GilbertQ .
Warm regards,
Yugandhar.
Hi Dave1mo1 ,
I hope everything is resolved on your side. If you need any additional information or assistance, please let me know. I'm happy to help.
Thank you,
Yugandhar.