Maybe this isn't implemented in the new GUI yet? When I click on delete recovery key, it seems to do something, but the option to delete it will still be there afterwards. And sure enough, you still can use the key to unlock the pool next time.