Forum Discussion

gp10's avatar
gp10
Advocate III
3 years ago
Solved

Redshift and Gateway issue

Hi community, I'm facing issues when trying to create a dataflow with Amazon Redshift data. The data that need to ne imported are over 1bn rows. I have tried to connect both with the Amazon Redshif...
Need Help
  • lbendlin's avatar
    lbendlin
    3 years ago
    Then the pbix file is so big that it cant be published.

    You can bootstrap the incremental refresh partitions to keep the original size under 10 GB. Then use XMLA refresh to fill each partition separately. This will then allow you to load datasets that are half the size of your capacity, and supposedly even beyond.

lbendlin's avatar
lbendlin
Super User
3 years ago

 

As for the RangeStart and RangeEnd filters I'm using the following:
RangeStart
1/1/0001 12:00:00 AM
RangeEnd
12/31/9999 11:59:59 PM
and I add a between filter.

 

 

Please don't do that. Do not use fake dates, and do not use a between filter (as that would make both dates inclusive).

 

Instead, use a subset of your dates (just enough for development)

 

RangeStart
1/1/2022 12:00:00 AM
RangeEnd
1/1/2023 12:00:00 AM

 

and then in your Power Query use a filter

 

[Date]>=RangeStart and [Date]<RangeEnd

gp10's avatar
gp10
Advocate III
3 years ago

That was it.
Thanks so much lbendlin, amazing support and guidance. Thanks.