Forum Discussion
Pull selected columns from Web source without removing after
Hi all,
I'm connecting to a ServiceNow table via a web source. That table has 155 columns of which I want around 30. I know I can pull all 155 and remove the ones I don't want, but is there a way I can just list out the 30 to pull in the first place and make it more efficient?
The first couple lines of my advanced editor currently look like this
Source = Json.Document(Web.Contents("https://xxxxxxxxxx/api/now/table/sn_customerservice_case?sysparm_query=sys_created_onRELATIVEGT@dayofweek@ago@30&sysparm_limit=500", [Headers=[Accept="application/json"]])),
#"Converted to Table" = Table.FromRecords({Source})
Thanks in advance
Hi daveedd
That does not matter, because only the first 1000 rows are loaded in power query, you can see the prompt in the lower left corner of the software. Hence, only the remaining columns will be loaded into the data model if you remove some columns in Power Query Editor.
-
However, when your Power BI Desktop file contains many queries, retrieving and storing preview data can extend the time it takes to complete a refresh. You'll achieve a faster refresh by setting the Power BI Desktop file to update the preview cache in the background.
In Power BI Desktop, you enable it by selecting File > Options and settings > Options, and then selecting the Data Load page. You can then turn on the Allow data preview to download in the background option.
Note this option can only be set for the current file.
FYI: Disable Power Query background refresh - Power BI | Microsoft Docs
Best Regards,
Community Support Team _Tang
If this post helps, please consider Accept it as the solution to help the other members find it more quickly.
3 Replies
daveedd , select 30, and remove others in power query.
amitchandak Thanks for the response - I was wondering if there's a way to limit the data coming in rather than removing after the initial pull. Pulling 125 unnessisary fields and then removing them feels inefficient.
Hi daveedd
That does not matter, because only the first 1000 rows are loaded in power query, you can see the prompt in the lower left corner of the software. Hence, only the remaining columns will be loaded into the data model if you remove some columns in Power Query Editor.
-
However, when your Power BI Desktop file contains many queries, retrieving and storing preview data can extend the time it takes to complete a refresh. You'll achieve a faster refresh by setting the Power BI Desktop file to update the preview cache in the background.
In Power BI Desktop, you enable it by selecting File > Options and settings > Options, and then selecting the Data Load page. You can then turn on the Allow data preview to download in the background option.
Note this option can only be set for the current file.
FYI: Disable Power Query background refresh - Power BI | Microsoft Docs
Best Regards,
Community Support Team _Tang
If this post helps, please consider Accept it as the solution to help the other members find it more quickly.
