Should I add CDN despite my server is close to my users?

The major advantage, if all your users are in the same local geographic area, is it reduces load on the server. The static files are served directly from the CDN to the users, and they don’t pass through the rails / ruby pipeline.