What is this code add_to_serializer in all these plugins

This should absolutely not be the default. Not all user custom fields should be displayed to the user (e.g. see Staff Notes).