Agree -> Keep Post flag option not working

How is that not working? You agreed with the flag, and the post was kept.

The flag has now been handled and will no longer appear in your unhandled flag list.