Update from 2.9.0 beta2 to beta4 failed (my site is down)

That error is coming from a migration which is technically correct. There is probably something else that is going wrong with your config.

You can probably try adding this to your configuration (usually app.yml) under hooks: (similar to how you would install a plugin).

  after_postgres:
    - exec: su postgres -c 'psql discourse -c "create extension if not exists unaccent;"'

This will create the extension you need as the postgres superuser.