Forum Discussion
Redshift and Gateway issue
- 3 years ago
Then the pbix file is so big that it cant be published.You can bootstrap the incremental refresh partitions to keep the original size under 10 GB. Then use XMLA refresh to fill each partition separately. This will then allow you to load datasets that are half the size of your capacity, and supposedly even beyond.
ErrorException Value cannot be null
gaps in primary key columns?
What are your incremental refresh settings? Which datetime column are you using for the partitioning?
Hi lbendlin ,
no gaps in any primary key column. I have tried with remove empty in power query but still get the same error.
Also, in other attempts I was deleting the primary key column to reduce size, since its not needed, but still no luck.
I have tried various incremental refresh setttings, from trying to pull the entire dataset with a setting like
bring data from last 5 years and refresh last 10 days, to last 3 months and last 5 days for example.
I'm trying to load a single table. I'm using it's datetime column.
- lbendlin3 years agoSuper User
Instead of a dataflow try using a dataset with incremental refresh.
- gp103 years agoAdvocate III
The issue with a dataset lbendlin is that incremental refresh doesn't seem to work with Amazon Redshift. Then the pbix file is so big that it cant be published. And if it is in a publishable size, again the first refresh will fail with similar errors from the gateway.
- lbendlin3 years agoSuper User
Then the pbix file is so big that it cant be published.You can bootstrap the incremental refresh partitions to keep the original size under 10 GB. Then use XMLA refresh to fill each partition separately. This will then allow you to load datasets that are half the size of your capacity, and supposedly even beyond.