Forum Discussion

bastienmol's avatar
bastienmol
Frequent Visitor
3 years ago

Large dataset usage optimization

Dear all,     I have a large dataset (200m rows) in a report.  The refresh part is managed with incremental refresh so I dont have any real issue with that.However the real issue is when the use...
Need Help
Tips and Tricks
bastienmol's avatar
bastienmol
Frequent Visitor
3 years ago

hi

 

Thanks for your quick response.

Something I guess I have forgotten to indicate in my post:

  • there is only one table in the dataset (so no relashionship etc...)
  • there is no calculations (so far)

I am basicaly just diplaying the data... That's why it is quite complicated to think and reduice the dataset.

 

Thanks

cassidy's avatar
cassidy
Power Participant
3 years ago

Okay, well even with 1 table there can be opportunity around field management, such as Data Types (Fixed Decimals, Whole Numbers, Date only vs DateTime), and removing unecessary columns.  Across 200m Rows, those things add up signficantly.

Concerning the report, if there are no relationships and no measures, I'd think the only thing left is the request for data is too large to be efficient.  What does the visual consist of? Is the visual displaying all 200m Rows?

High performing visuals are typically summaries of data with limited fields and rows, conversely the more fields and rows exposed to the User the worse it would perform.

  • bastienmol's avatar
    bastienmol
    Frequent Visitor
    3 years ago

    thanks for you reply. 

     

    Visual is mainly one table (6 columns) - with 6 filters at the top.