Forum Discussion

tcloran's avatar
tcloran
Frequent Visitor
2 years ago
Solved

Update backfill in chunks for incremental refresh

I'm using a large table as a dataset in Power BI. I applied an incremental refresh to this dataset, but after publishing with the initial scope defined by the RangeStart and RangeEnd, it requires a o...
Need Help
  • lbendlin's avatar
    lbendlin
    2 years ago

    Use CSV or Parquet files as fake partitions and then append them in Power Query.   Yes, you will reload all the data each time but both CSV and Parquet are ingesting very fast.

lbendlin's avatar
lbendlin
Icon for Super User rankSuper User
2 years ago

Use CSV or Parquet files as fake partitions and then append them in Power Query.   Yes, you will reload all the data each time but both CSV and Parquet are ingesting very fast.

tcloran's avatar
tcloran
Frequent Visitor
1 year ago

Sorry if this is a novice question but how would I create separate csv files out of a sql table/view? This needs to be an automated, scheduled refresh.