API timing issues

[PDKing]

Is there any relevance to 10am (central) when trying to send data to a Semantic Dataset through the PowerBi API?

I have a script monitoring a log file on multiple machines. When the script sees the log file change it pulls the relevant data from the log file and sends the data to to post in a streaming dataset via the API (and an email to me). Each day I get multiple emails with data for events from the log file prior to 10am, but that data never shows in my PowerBi report. Any data sent after 10am from the same script loads fine. My firewall team has confirmed that the traffic is leaving our firewall.

[PDKing · Accepted solution]

The 10am mystery has been resolved.

I was creating the DateTime input for the dataset from the log time value being written to the log I am monitoring. Hours before 10am are being written as a single digit to the log and that does not meet the format requirements for the dataset. If anyone else is having a similar issue below is how I resolved mine (PS script).

    $Year = Get-Date -Format yyyy

    $Day = Get-Date -Format dd

    $Month = Get-Date -Format MM

    $H = Get-Date -Format HH

    $M = Get-Date -Format mm

    $S = "00"

    $MS = "000"

    $DateTime = $Year + "-" + $Month + "-" + $Day + "T" + $H + ":" + $M + ":" + $S + "." + $MS + "Z"

[lbendlin]

 sends it off to the API

Please elaborate. Are you pushing rows into a streaming dataset or are you requesting a dataset semantic model refresh ?  The latter is subject to throttling/discarding if you issue too many requests, or if you issue a request while a refresh is already in progress.

[PDKing]

This issue is when attempting to push data into a streaming dataset.

[lbendlin]

There are some limitiations on the push frequency but I wouldn't think they would cause your situation. Check them out anyway.

Power BI REST APIs push semantic model limitations - Power BI | Microsoft Learn