Unable to renew Let's encrypt certificate

I had that very same problem a few months ago. I‘ve tried everything I could find on meta but in the end a simple restart of the server solved it for me.