Don't miss your chance to take the Fabric Data Engineer (DP-700) exam on us!
Learn moreWe've captured the moments from FabCon & SQLCon that everyone is talking about, and we are bringing them to the community, live and on-demand. Starts on April 14th. Register now
I found an article that helped me paginate the REST API, however i'm not sure how to use Web.Content() to make the source static while using offset.
This is the code i'm using :
let
EntitiesPerPage = 500,
Url = "https://OurOracleCloudLink.com/hcmRestApi",
GetJson = (Url) =>
let
RawData = Web.Contents(Url,[RelativePath="/resources/11.13.18.05/workers",Query =[limit="500",totalResults="true"]]),
Json = Json.Document(RawData)
in Json,
GetEntityCount = () =>
let Url = Url,
Json = GetJson(Url),
Count = Json[#"totalResults"]
in
Count,
GetPage = (Index) =>
let
offset = "&offset=" & Text.From(Index * EntitiesPerPage),
Url = Web.Contents(Url,[RelativePath="/resources/11.13.18.05/workers",Query =[limit="500",totalResults="true",offset=Number.From(Index * EntitiesPerPage)]]),
Json = GetJson(Url),
Value = Json[#"items"]
in
Value,
EntityCount = GetEntityCount(),
PageCount = Number.RoundUp(EntityCount / EntitiesPerPage),
PageIndices = { 0 .. PageCount - 1 },
Pages = List.Transform(PageIndices, each GetPage(_)),
Entities = List.Union(Pages),
Table = Table.FromList(Entities, Splitter.SplitByNothing(), null, null, ExtraValues.Error)
in
Table
I tried so many different ways, but it always tells me to convert the Offset value to binary or text, but whenever I do that, it tells me that it wants the value in a different type.
Thanks in advance.
@Asalk , Have you already checked these
https://medium.com/@marktiedemann/how-to-do-pagination-in-power-query-430460c17c78
Hey @amitchandak ,
I checked the two articles you mentioned, unfortunately I have already checked these before. My main problem is with offset
GetPage = (Index) =>
let
offset = "&offset=" & Text.From(Index * EntitiesPerPage),
Url = Web.Contents(Url,[RelativePath="/resources/11.13.18.05/workers",Query =[limit="500",totalResults="true",offset=Number.From(Index * EntitiesPerPage)]]),
Json = GetJson(Url),
Value = Json[#"items"]
in
Value,
i'm trying to wrap my head around it. this is my first time using REST API as we just have moved to Oracle Cloud, and it seems this is the only way to connect Power BI to SaaS.
Thanks.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.
Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.
| User | Count |
|---|---|
| 53 | |
| 37 | |
| 35 | |
| 19 | |
| 17 |
| User | Count |
|---|---|
| 74 | |
| 70 | |
| 39 | |
| 35 | |
| 23 |