Get ApacheAirflowJob Starter pool status via API using service principle credentials
I need a way to check the status of a starter pool in an apacheAirflowJob remotely, so that my infrastructure automation may respond. It will also be useful to be able to start the pool if in stopped state. I have a use case where I need to run a short job once per day, but sometimes if the starter pool is paused there is no way to wake it up (even by trying to run the job as the docs suggest). It is as though airflow doesn't exist. Being able to check the status, similar to the getStatus api the page uses would allow a terraform script to respond appropriately (and then request to start the pool thus making it available to the airflow job). This is required stuff for automated business workflows. I need this to run daily at a very unsociable hour, but only once and for the remainder of the day do not need the airflow tools, so starter pool with its power down after 20 minutes of inactivity is perfect for a small workload like this. It's a nice solution using git repo to store dags and a cost efficient pool. However, it is not a viable solution until it can be included in automation scripts. Please add the APIs to poll status and start/stop the pool so that a managed identity or service principle may be used to make the requests and recieve responses if they have Power BI delegated and application permissions and are included in the list of workspace users.
Recent ideas
Allow NotebookUtils getSecret() to authenticate with Workspace Identity
Current behavior In Microsoft Fabric, notebookutils.credentials.getSecret() authenticates against Azure Key Vault using the identity of the user who executes the notebook. This behavior appli...tmihara3 hours agoNew MemberNew4Views0likes0CommentsSupport Synonyms in Fabric Warehouse
Microsoft SQL Server has a very powerful feature by the way of "synonyms." It allows users and DBAs to do all sorts of powerful magic such as rewiring objects under the hood (e.g. run the code agains...matthias-bi6 hours agoRegular VisitorNew1.3KViews18likes2CommentsExpose Refresh Warnings and Informational Messages via Notifications and API
When a Power BI semantic model refresh completes successfully, the status shows Completed, even when the refresh details contain warnings or informational messages that require attention. Please pro...Jashwanth_K8 hours agoMicrosoft EmployeeNew23Views6likes0CommentsInvoke Pipeline Task - Workspace Identity Authentication
Currently, the Fabric Data Factory Invoke Pipeline task uses the user's credentials who saved the pipeline to then authenticate to the Azure Data Factory to execute the ADF pipeline. When that user'...dzebrowitz13 hours agoAdvocate IPlanned1.8KViews61likes5CommentsFabric Pipeline should run as workspace identity
Currently, Microsoft Fabric pipelines run under the identity of the last user who modified them, which can cause disruptions when tenant administrators make changes to security policies, such as enab...pellitteris13 hours agoAdvocate IINew1.4KViews27likes3Comments