The table that stores visits use a plain date, not a timestamp, so implementing a tolerance of a few hours is not feasible.
It all depends on what your community wants in the end. You could disable that badge and create an equivalent custom one that triggers with less days so it is enough to cover those days. Or check for users whose visit gaps are never more than 1 day.