External system letter avatars fail to download

Installation
1

I’ve got a high-volume site (~2 million page views/month) that I have just migrated from Hosted. There are no non-official plugins.

I have a bunch of rails logs like:

Failed to process hijacked response correctly : undefined method `path' for nil:NilClass

I also have a bunch of nginx logs like:

[18/Mar/2019:13:16:51 +0000] "www.ketogenicforums.com" 77.16.221.99 "GET /letter_avatar_proxy/v3/letter/s/53a042/90.png HTTP/2.0" "Mozilla/5.0 (iPhone; CPU iPhone OS 12_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) CriOS/73.0.3683.68 Mobile/15E148 Safari/605.1" "user_avatars/show_proxy_letter" 500 258 "https://www.ketogenicforums.com/t/abnormal-run-training-heart-rates/32348/32" 0.048 0.047 "-"

From the UX logs I see

/var/www/discourse/app/controllers/user_avatars_controller.rb:158:in `proxy_avatar'
/var/www/discourse/app/controllers/user_avatars_controller.rb:47:in `block in show_proxy_letter'
/var/www/discourse/lib/hijack.rb:56:in `instance_eval'
/var/www/discourse/lib/hijack.rb:56:in `block in hijack'
/var/www/discourse/lib/scheduler/defer.rb:94:in `block in do_work'
/var/www/discourse/vendor/bundle/ruby/2.5.0/gems/rails_multisite-2.0.6/lib/rails_multisite/connection_management.rb:63:in `with_connection'
/var/www/discourse/lib/scheduler/defer.rb:89:in `do_work'
/var/www/discourse/lib/scheduler/defer.rb:79:in `block (2 levels) in start_thread'

I can’t tell if it’s related to this: Avatars are broken after migrating to minio

2

Where are you serving the avatars from?

3

I’ve got external system avatars enabled and the external system avatars url that was in the database when I got it. Perhaps I should disable the external system avatars?

image

4

That happens when the server fails to download the avatar from the external system. It might have run into a timeout… The particular avatar from the error message seems to work fine right now.

3 Likes
5

I"m getting about 1.5/second. Does that seem normal?

image
image.png914×285 21.3 KB

(And Ah! I do see that one that was missing is now showing up. . .)

6

No, it’s not normal. Is your server still under high load from the migration or is the server’s internet connection saturated?

1 Like
7

Yeah. The load average is > 8 (there are 8 cpus).

But, Sidekiq queue is empty, so I’d think that this is an expected load. I don’t have access to stats on network health. More server stats at Expected 99th percentile performance

Edit: this was soon after a reboot. It looks like these errors have dropped to near zero.

1 Like
8

I’m surprised to see this thread, because whatever you’ve been seeing in the log, Jay, it didn’t affect the user experience.

None of the moderators noticed any trouble with letter avatars before or after today’s reboot, and we would definitely have gotten complaints if any users had noticed. The only noticeable trouble with avatars was during a brief period at the beginning of the migration, and it involved all avatars, not just the letters.

At least today’s reboot seems to have put an end to the unwanted summary e-mails problem, thanks be.

9

Great! That’s glad to hear, @PaulL. I was tasked with seeing that the system is performing the best it can, so that’s what I’m doing. When I looked at the /users page, I did see missing avatars both there and on a user profile, so I am doing everything that I can to see that the problem is resolved.

The good news is that it seems that this particular problem seems to have gone away.

3 Likes
10

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.