I recommend first instrumenting the delay before taking action.
Email headers have detailed information on how long they took to be related at each hop.
Even before that though, take a look at email time window mins which is 10 minutes by default.
I would start with lowering that if it suits your users.