You can permanently delete from the console, but there is now an easier option that will allow you to do it from the UI. You do need to enable a hidden site setting, but you can find the instructions here: