datorres8's avatar
datorres8
New Member
1 day ago
Status:
New

Dynamic SQL Pools in Warehouse

Custom SQL Pools is now in preview, but I see a limitation in the sense that you cannot allocate more than 100% capacity to all pools.  I would like to see the ability to create multiple pools and assign pools a priority.  I am considering an example where I have heavy ETL workloads that run late at night that I would want to grant 100% of resources with a medium priority.  At the same time, I want an intraday ETL pool at uses 35% with a high priority and a pool for reporting that is allocated up to 70% with a medium priority.  In this configuration, we have pools subscribing to more than 100%, but the scheduler could grant nodes based on priority.

No CommentsBe the first to comment

Recent ideas