I believe when you track an array like described in OP you’re tracking the array reference and not changes to the individual objects within the array
Another way to handle it is using trackedObject, we use this in a handful of places throughout Discourse