@sam I’ve made this work by adding one optional field named spaces_endpoint to site settings.
This enables Spaces support for all existing S3 features like upload, delete etc.
Does this look fine to you?
spaces_endpoint:
default: ''
Here’s an image of the new Settings/Files page: