Loading large data

[Rahulmg2002]

Hello all, 

I am having an issue loading data in PowerBI Report. I have all my data files in Sharepoint folder. I have imported all the files successfully and the done some transformations( Unpivot tables), which incresed the row numbers considerably( in millions).

Now when i am applying  my tranformation, loading of this data tables taking ages.

Anybody can help me to find the possible solution for this situation?

many thanks

RG

[Idrissshatila]

Hello @Rahulmg2002 ,

Try removing the unnecessary columns that won't be needed the in analysis.

also if you can limit the data to a specifi date range that would help by not taking all data if it's also not needed in the analysis.

also I recommend building the Model as a star schema Model https://learn.microsoft.com/en-us/power-bi/guidance/star-schema

If I answered your question, please mark my post as solution, Appreciate your Kudos 👍

Follow me on Linkedin

[Rahulmg2002]

@Idrissshatila thank you for the reply, at this stage i am trying to load only one fact table and that is taking long time to load. mine report should analyis langitudinal trand over time (2018-2022). data is static once ina year i may need to upload new data. 

[Idrissshatila]

Hello @Rahulmg2002 ,

so working it as a star schema where you define your variables in dimensions tables and keep in the fact Ids and number values will provide a better performance.

also you could try direct query https://learn.microsoft.com/en-us/power-bi/connect-data/desktop-use-directquery

If I answered your question, please mark my post as solution, Appreciate your Kudos 👍

Follow me on Linkedin

[Rahulmg2002]

@Idrissshatila , my data isin Sharepoint folder. i am not sure if we can do direct query on sharepoint folder? 

[Idrissshatila]

Hello @Rahulmg2002 ,

True, it doesn't support direct query, it should be a relational database Model.

If I answered your question, please mark my post as solution, Appreciate your Kudos 👍

Follow me on Linkedin

[Rahulmg2002 · Accepted solution]

@Idrissshatila thank you for your suggestions. i have figured it out the issue with slow upload. I was merging another table  with the condition and that was slowing my data loading. After removing that step there is no issue in loading my data.