I found the culprit. I have the ClearURLs FF add-on installed and it has an option of
Filters ETag headers from requests (See also this article)
I disabled that setting and it now works, uploading the photo below from FF non-incognito window.
Thank you for helping me debug this!