Finally fixed it with
gem install bundler -v 2.5.3
Not sure why it didn’t know to install the version that it wanted.