Don't miss your chance to take the Fabric Data Engineer (DP-700) exam on us!
Learn moreWe've captured the moments from FabCon & SQLCon that everyone is talking about, and we are bringing them to the community, live and on-demand. Starts on April 14th. Register now
In Power BI, I want to connect to a SharePoint list and filter the data that is imported.
I need the filter to be applied before the data is imported. The list has about 20,000 records and I only need about 200 items filtered by content type.
I have connected to the SharePoint list and then applied a filter on the column. Does this filter import the results before or after importing the data?
Solved! Go to Solution.
Any filters that you do as part of the Power Query, work on the data as passed to that specific line in the Power Query itself. So the question goes back to, have you already downloaded those rows in earlier statements in your Power Query? By the way you described it, the answer is likely yes.
If you are connecting to an SQL database, you have the ability to include an SQL statement, that can offer the ability to pre-filter the data as part of the connection. This allows you to only source the minimum rows you require.
When connecting to a SharePoint list, you first connect to the site and then "Navigate" to the list contents itself. Generally this navigation line of code looks like
Source{[Name="YourListsName"]}[Content]Where [Content] is the column containing the whole table for each list
From what I can tell, there is no expansion parameters here that let you expand the table found in [Content] but only for certain rows.
When you filter in the next steps, Power Query will have already downloaded each row.
ALTERNATIVE. I'm not sure if you are using On-Premise SharePoint or not, we have a database set up that gives me direct access to our SharePoint data. Since its an SQL database, i'm able to make SQL statements to get access to everything I need. This allows me to optimise what rows are returned.
Any filters that you do as part of the Power Query, work on the data as passed to that specific line in the Power Query itself. So the question goes back to, have you already downloaded those rows in earlier statements in your Power Query? By the way you described it, the answer is likely yes.
If you are connecting to an SQL database, you have the ability to include an SQL statement, that can offer the ability to pre-filter the data as part of the connection. This allows you to only source the minimum rows you require.
When connecting to a SharePoint list, you first connect to the site and then "Navigate" to the list contents itself. Generally this navigation line of code looks like
Source{[Name="YourListsName"]}[Content]Where [Content] is the column containing the whole table for each list
From what I can tell, there is no expansion parameters here that let you expand the table found in [Content] but only for certain rows.
When you filter in the next steps, Power Query will have already downloaded each row.
ALTERNATIVE. I'm not sure if you are using On-Premise SharePoint or not, we have a database set up that gives me direct access to our SharePoint data. Since its an SQL database, i'm able to make SQL statements to get access to everything I need. This allows me to optimise what rows are returned.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.
Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.
| User | Count |
|---|---|
| 53 | |
| 37 | |
| 35 | |
| 19 | |
| 17 |
| User | Count |
|---|---|
| 74 | |
| 72 | |
| 39 | |
| 35 | |
| 23 |