When “tags sort alphabetically” is enabled, when you navigate to the “tags” page, they do sort alphabetically, but “count” is still highlighted initially.
Just turned off that site setting because now I do want to sort by count initially anyway, but I was very confused about this for the past day and thought the default sort by “count” was broken.