Forum Discussion
Power BI Api Connection via Query Editor - Unable to Load Complete Data Entries (Only 25 returns)
Looks like you already set the pagination to 1000 which seems to be a reasonable number. What is the format of the returned payload? Is it JSON? For each row in your screenshot 1 you need to covert the binary into a usable table (by parsing the JSON, for example) before you can then combine the results.
The column profiling feature is unrelated to your issue.
Hello lbendlin ,
Thanks very much for your reply.
Screenshot 1 is the outcome after doing the query above, which has been parsed into JSON. As soon as I clicked the Icon on the top right corner, it shows detailed data entries in a table. (p.s. Screenshot 2 is the result by clicking through each 'Binary' value in screenshot 1, showing 25 items in total)
And I converted it to a table that shows in total 3750(150rows*25items) returns, which does not match with the initial records(should be over 130000 data entries). As there's a huge gap between the data I've got with M query and all records in the data warehouse. I would like to know if you suspect anything wrong with my query or if I didn't query all data. Also, if I increase the list numbers, the result shows a value duplicated several times rather than all data records exported from the platform. I am also thinking about the possibility of API limitation in retrieving the number of data.
I would appreciate knowing if you have any thoughts on this issue. Thanks.
Kind Regards,
Jessica
Here is an article that goes into nice detail on how to handle situations like yours.
Handling paging for Power Query connectors - Power Query | Microsoft Learn
Without access to your API it is unfortunately very difficult to help much further.