Forum Discussion
Impactful IndividualCan PowerBI handle a large flat file?
probably, it handles millions of rows on some of my stuff. I did run into memory issues on one report, but expanding my paging file fixed that pretty quick
- ovetteabejuela
why I asked?
I am currently spear-heading a PowerBI project and I have a team of a little over 50, PowerBI or it's concepts are relatively new to some.
I would like to buy some time by letting them do a flat-file until such time I can oversee everyone (I will be training everyone in a group, but I know for myselft that it's hard to grasp the entire concept) Even I am still fumbling from here and there.
So again... the flat file will implement the project(s) and improvements will follow.
Seems like a good way to get started.
I switched a large project to use a text file, because one of the users couldn't refresh the report due to credential issues on the database. I'm a consultant, so I need to leave them with something they can use so I set up SSIS to drop the file in their directory each week. It's a ranking of products sold that week by the chain and each store. The products sold run about 8 or 9 thousand a week and 127 stores. And it works fine with 8gig of ram on the machine and the pagefile is now 16gb.
- ovetteabejuela
Min's totally different, it's diverse. each of my team members handles unique businesses that one challenge, these businesses can range from small to large population. There maybe common areas maybe around 40% but the rest are different (maybe some common to some) so just like you I will train them with the concept, let it sink in and they initiate their business PowerBi reporting... I will try to be there to each one of them for support even though I'm new to PowerBi myself although the concept is not new to me.
Thank you for sharing, I think I'm a little more confident the approach is not that bad at all.
