Forum Discussion
Data Refresh Storage and Traffic Concerns
If this is an on-premise database, then Power BI Service uses an on-premises gateway to perform the data load. Currently, Power BI does not have incremental load so all 10,000,000 records plus additional would be refreshed. If that original data never changes and latency is a concern what I would do would be to create a view in your database and 2 or 3 queries. Essentially, create one query that grabs all of your original data. Then, create a view that only shows new data. Create another query to grab that data from that view. Append the two queries. This way, you will only refresh a subset of your data and not all 10,000,000 records every time.
You could also use Direct Query, which pulls the data real time instead of importing.
If this is an on-premise database, then Power BI Service uses an on-premises gateway to perform the data load. Currently, Power BI does not have incremental load so all 10,000,000 records plus additional would be refreshed. If that original data never changes and latency is a concern what I would do would be to create a view in your database and 2 or 3 queries. Essentially, create one query that grabs all of your original data. Then, create a view that only shows new data. Create another query to grab that data from that view. Append the two queries. This way, you will only refresh a subset of your data and not all 10,000,000 records every time.
You could also use Direct Query, which pulls the data real time instead of importing.
Thanks! Your explanation helps and answers my question.