The settings in that component work like this:
Do you have the last part of the setting set as remove? You’d need to change that to keep
remove
keep