Checking in to see if you had any luck getting it to work as I haven’t seen many other reports of this. At least for Meta and other sites hosted with us, they are supposed to work out of the box.
For self-hosted instances, push notifications are not expected to be working out of the box but the two workarounds I know of are Whitelisted Discourse app with Push Notifications via OneSignal and Pushover notifications.