API Pagination with scroll ID

Hi Everyone, 

Thanks for your assistance with this. I managed to retrieve 852,320 rows of enrollment data. However, it appears that all but 659 of the retrieved rows are duplicates.

Could this be because the Scroll ID is not being passed correctly? As I understand it, each subsequent query must use the new Scroll ID returned from the previous scroll request.

let
    TokenResponse =
        Json.Document(
            Web.Contents(
                "https://auth.go1.com",
                [
                    RelativePath = "/oauth/token",
                    Headers = [
                        #"Content-Type" = "application/x-www-form-urlencoded",
                        Accept = "application/json"
                    ],
                    Content =
                        Text.ToBinary(
                            Uri.BuildQueryString(
                                [
                                    client_id = "IDHERE",
                                    client_secret = "SECRETHERE",
                                    grant_type = "client_credentials"
                                ]
                            )
                        )
                ]
            )
        ),
    AccessToken = TokenResponse[access_token],
    BaseUrl = "https://api.go1.com/v2/enrollments",
    FirstResponse =
        Json.Document(
            Web.Contents(
                BaseUrl,
                [
                    Query = [scroll = "true"],
                    Headers = [
                        #"api-version" = "2022-07-01",
                        Authorization = AccessToken
                    ]
                ]
            )
        ),
    ScrollId = try FirstResponse[_scroll_id] otherwise null,
    FirstHits = try FirstResponse[hits] otherwise {},
    GetScroll = (sid as text) =>
        try
            Json.Document(
                Web.Contents(
                    BaseUrl,
                    [
                        Query = [
                            scroll = "true",
                            scrollid = sid
                        ],
                        Headers = [
                            #"api-version" = "2022-07-01",
                            Authorization = AccessToken
                        ]
                    ]
                )
            )
        otherwise null,
    Pages =
        List.Generate(
            () => [
                Sid = ScrollId,
                Result = FirstHits,
                More = true
            ],
            each [More] = true and [Sid] <> null,
            each
                let
                    next = GetScroll([Sid]),
                    hits =
                        if next <> null
                        then try next[hits] otherwise {}
                        else {},
                    newSid =
                        if next <> null
                        then try next[_scroll_id] otherwise null
                        else null
                in
                    [
                        Sid = newSid,
                        Result = hits,
                        More = List.Count(hits) > 0 and newSid <> null
                    ],
            each [Result]
        ),
    Combined =
        List.Combine(Pages),
ResultTable =
    Table.FromRecords(
        Combined,
        null,
        MissingField.UseNull
    )
in
    ResultTable

 Below is the headers the query returns:

Total rows : 789,157 (Checked in the portal this is correct)