It will be possible. It will work like this.
The canned replies will be stored inside a category. The first post of each topic in this category will be used as the templates.
Doing so, it will be possible to create sub-categories in this “template” category and adjust the view permissions in this sub-categories, everyone who can see the topics that are the canned replies templates will be able to use them.
So you could create three sub-categories, each one containing a set of canned replies, and each one visible to a particular group. Then each group would be able to use a different selection of canned replies as you asked.