Anytime you change the active alert policy and save it, you must reactivate the alert policy to have the changes take effect.
To reactivate the active alert policy
In the navigation pane, expand the Alert Policies node.
Select the currently active alert policy and click Reactivate on the Action menu.