Sorry about that @hellekin there were indeed a few bugs hidden in that feature
https://github.com/discourse/discourse/pull/38872