Forum Discussion
SaiK
Helper I
1 year ago100 GB data on AWS Workspace
I have approx 100GB dataset in Power BI. I am importing this data from MySQL DB.An issue here is am unable to import the entire data because of the size.How do I workabout this issue? I am also usin...
- 1 year ago
Pre-aggregate means to summarize the data using GROUP BY instead of loading all rows. For example instead of loading by transaction id or transaction lines, group the rows by a certain column.
- 1 year ago
Ohh yess, that is something I could do. Instead of applying the measures after importing shall apply GROUP BY before importing. Thanks a lot!!
MFelix
Super User
1 year agoHi SaiK,
Have you tried to execute a stored procedure to create a new table with the aggregation data and then get the SELECT * from that new table?
SaiK
Helper I
1 year agoHi Felix,
After having a discussion with my team, turns out we will have to build a ETL pipeline to extract the data, peform some transformations on it prolly on DBT and then load the data to Power BI.