Thanks Gerhard! I appreciate your help. This one is just getting stranger and stranger.
It doesn’t make sense to me that there was a problem with incoming_referers to me either. I’ve done a restore from production to this staging site as recently as October.
It seems like there’s something wrong with the database or the indexes. I suspected a plugin, but the errors are in enough different indexes that it seems improbable that a single plugin might be to blame. An earlier grep through plugins for the broken index issues came up empty.
One restore I got this:
[2020-01-03 16:25:30] ERROR: could not create unique index "index_plugin_store_rows_on_plugin_name_and_key"
I did:
[10] pry(main)> PluginStoreRow.where(plugin_name: 'discourse-data-explorer',key: 'q:-8').destroy_all
And tried again:
[2020-01-03 16:49:16] ERROR: could not create unique index "index_tags_on_lower_name"
[2020-01-03 16:49:16] DETAIL: Key (lower(name::text))=(addins) is duplicated.
Here’s the full head of the latest restore:
[2020-01-03 16:41:34] 'pfaffman' has started the restore!
[2020-01-03 16:41:34] Marking restore as running...
[2020-01-03 16:41:34] Making sure /var/www/discourse/tmp/restores/default/2020-01-03-164133 exists...
[2020-01-03 16:41:34] Downloading archive to tmp directory...
[2020-01-03 16:45:20] No metadata file to extract.
[2020-01-03 16:45:20] Validating metadata...
[2020-01-03 16:45:20] Current version: 20191220134101
[2020-01-03 16:45:20] Restored version: 20191129144706
[2020-01-03 16:45:20] Extracting dump file...
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:15] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] CREATE INDEX
[2020-01-03 16:49:16] ERROR: could not create unique index "index_tags_on_lower_name"
[2020-01-03 16:49:16] DETAIL: Key (lower(name::text))=(addins) is duplicated.
[2020-01-03 16:49:16] ERROR: current transaction is aborted, commands ignored until end of transaction block
[2020-01-03 16:49:16] ERROR: current transaction is aborted, commands ignored until end of transaction block
[2020-01-03 16:49:16] ERROR: current transaction is aborted, commands ignored until end of transaction block