Forum Discussion
Data import takes long time from azure SQL Data Warehouse
- 10 years ago
Ok, I think I get the problem now. The refresh is fine in the cloud, but you can't refresh it in desktop to bring in the new columns and create additional charts/graphs.
Can you temporarily limit the row count of the actual source table in Azure? I'm not sure how much control you have over the table there, or what feeds it. If you can temporarily remove rows (e.g., move them to another table, or prevent x rows from populating), you could then update your report to get the new columns and create your new visuals. Once everything is set in the report and it's uploaded to Power BI for data refresh, you could set your source table back to include all rows.
Ideally you could save changes to your query without reloading the entire data set, but I can't find a way to do that. It would be nice to just put a row limit on your table in the query editor, bring in the new columns and create the visuals, and then take the row limit off without bringing in the whole set.
Are you pulling in more data than you need for your model, as opposed to pulling in all data in the tables? If you don't need every column, you can select the ones that are pertinent to your reporting and ignore the rest. Are the new columns that are coming in wanted, or are you looking for a way to keep them out of the model?
If you can filter out any rows that aren't needed, e.g., dates that aren't relevant, that will also help.
Basic I know, but that's where I'd start.
Thanks for your reply,
We have total columns 12 and 3 new columns came. we want to get that columns into model only option is refresh. At that time of refresh we have 60 millions of data. we are not getting any solution without refresh getting the columns into model for creation of new charts based on 3 newly added columns.