Don't miss your chance to take the Fabric Data Engineer (DP-600) exam for FREE! Find out how by attending the DP-600 session on April 23rd (pacific time), live or on-demand.
Learn moreNext up in the FabCon + SQLCon recap series: The roadmap for Microsoft SQL and Maximizing Developer experiences in Fabric. All sessions are available on-demand after the live show. Register now
I have the following Query to get data from a sharepoint list. Currently all the values are manual and I am only viewing and skipping a small number of rows.
let
Source = Json.Document(Web.Contents("http://<tenant>.sharepoint.com/sites/<directory>/_api/web/lists/GetByTitle('<name>')/items?$skiptoken=Paged=TRUE%26p_ID=5&$top=10&$select=Id",[Headers=[Accept="application/json"]])),
value = Source[value],
#"Converted to Table" = Table.FromList(value, Splitter.SplitByNothing(), null, null, ExtraValues.Error),
#"Expanded Column1" = Table.ExpandRecordColumn(#"Converted to Table", "Column1", {"Id"},{"ID"})
in
#"Expanded Column1"
When changing skiptoken=Paged=TRUE%26p_ID= between 0 and 5, nothing changes in the output; it still shows the first 10 rows of data. I found this code on various websites and am fairly certain I have copied it exactly so I am unsure why the skiptoken part is not working.
Thanks in advance
The solution in this page contains the video to the code I am using:
Solved! Go to Solution.
Hi @Jojo197 - Please use the Power Query SharePoint Online list connector - Power Query | Microsoft Learn connector instead. I also recomend using Implemention="2.0" for the best performance and features.
Hi @Jojo197 - Please use the Power Query SharePoint Online list connector - Power Query | Microsoft Learn connector instead. I also recomend using Implemention="2.0" for the best performance and features.
Thank you, this did what I needed. Is there a reason why the skip token wasn't working with what I was doing?
Web.Contents does not have easy mechanism to capture the User Credentials to generate a token. You would need to develop a custom connector or a function to call for the token.
Instead, you could have switched to using the OData.Feed function instead of web contents. This will prompt for user credentials.
But I would not recommend because the new SharePoint.Tables approach is optimised for better performance and would require less additional transformations (e.g. renaming and data type conversions).
I tried the Web.Contents approach because the 2.0 implementation of the SharePoint connector is giving me a 500 internal server error. I have a list where the 2.0 implementation broke when the list went over 5000 items. I have other SP lists over 20000 items, and the 2.0 implementation is working fine. Any ideas? Hair is falling out over here.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.
Experience the highlights from FabCon & SQLCon, available live and on-demand starting April 14th.
| User | Count |
|---|---|
| 5 | |
| 3 | |
| 3 | |
| 3 | |
| 2 |
| User | Count |
|---|---|
| 7 | |
| 5 | |
| 5 | |
| 5 | |
| 4 |