It’s a little convoluted, but if you wanted to add some CSS (admin > customize > themes) to disable this behavior in filtered results… it’s possible:
.directory:has(.filter-name:not(:placeholder-shown)) .me {
display: none;
}
this essentially says “if the directory filter is not showing the placeholder (i.e., a term has been entered) then don’t display my account in the results”
but note this would also remove yourself from matching filters, so it’s an imperfect workaround