New "Has your question been answered" popup can't be permanently dismissed

Do you have allow solved on all topics set in your admin settings? I think that removes the category by category setting: