Pause button for outbound alerts

I would like to see a “pause” button for outbound alerts.
This would come in handy during a page storm. There should also be a way to see
what is in the queue as a result of the “pause” and quickly delete the
contents.