Forum Discussion
Data import takes long time from azure SQL Data Warehouse
- 10 years ago
Ok, I think I get the problem now. The refresh is fine in the cloud, but you can't refresh it in desktop to bring in the new columns and create additional charts/graphs.
Can you temporarily limit the row count of the actual source table in Azure? I'm not sure how much control you have over the table there, or what feeds it. If you can temporarily remove rows (e.g., move them to another table, or prevent x rows from populating), you could then update your report to get the new columns and create your new visuals. Once everything is set in the report and it's uploaded to Power BI for data refresh, you could set your source table back to include all rows.
Ideally you could save changes to your query without reloading the entire data set, but I can't find a way to do that. It would be nice to just put a row limit on your table in the query editor, bring in the new columns and create the visuals, and then take the row limit off without bringing in the whole set.
My Data was not Static, it's coming from one table(i.e Denormalized) from AZURE DW. Data will increase on daily. As you Suggested about filter the data, but I dont want to place any filter on the data. In Desktop in preview mode the newly columns showing with data of limited rows but when I click on "Close & Apply" button it's trying to load the entire data. How we can control without loading 60 millions of records with these new columns. In desktop it's taking huge time for loading 60 million reocrds. once we published the pbix in cloud service, 60 million records loading very faster.
Ok, I think I get the problem now. The refresh is fine in the cloud, but you can't refresh it in desktop to bring in the new columns and create additional charts/graphs.
Can you temporarily limit the row count of the actual source table in Azure? I'm not sure how much control you have over the table there, or what feeds it. If you can temporarily remove rows (e.g., move them to another table, or prevent x rows from populating), you could then update your report to get the new columns and create your new visuals. Once everything is set in the report and it's uploaded to Power BI for data refresh, you could set your source table back to include all rows.
Ideally you could save changes to your query without reloading the entire data set, but I can't find a way to do that. It would be nice to just put a row limit on your table in the query editor, bring in the new columns and create the visuals, and then take the row limit off without bringing in the whole set.