DBT Job test warnings causing job failure

I have tests configured to have a severity of warn, and these are still causing my dbt job to fail. I am not using any of the dbt features that cause warnings to be escalated to errors. Is this expec...