Forum Discussion

kenny_lkg's avatar
kenny_lkg
New Member
2 years ago

PBI Datamart - Managing bigger Fact Tables

Hello,
I have a bigger FACT table that I loaded from AWS Athena using an ODBC Dataflow into a Datamart.
There are a few issues including: - Slow loads / save - I am trying to reduce rows loading by using a parameter but that seems to convert the tables to "Linked Entity" which then fails the load
Questions: - Can I use parameters to reduce initial load then reset the parameter when I go and publish data from it ? - And if so, what are the correct steps to accomplish this?
The next thing I can think of is using XMLA endpoint and partition things out which seems more difficult and harder to manager
Thanks in advance for your help and insights
dataflow

1 Reply

  • Anonymous's avatar
    Anonymous
    Not applicable
    1 year ago

    Create a table/view (outside of the Power Query transform section) and add to dataflow. It will contain one column (date data type) and enter a date initally that will return small dataset. Then update the table or view with a date that will return a larger dataset and refresh the dataflow.