Are you sure this happens because of the follow plugin?
Even without that plugin, there is no button at the top. Instead, on mobiles, the link to the user’s admin page is located in the menu below.
