Since you can not add non-patron members to the patreon group, you can create another patreon group using another name such as “other-patrons” (or “supporters”, benefactors" etc …). Configure this group with the same privileges you have given to patreon group and add members manually (or allow users to request participation in the group).
You can automatically assign a badge to that group, see