Yes, it’s intentional that we don’t remove you from chat channel membership when you change your RSVP. There are still valid reasons to want to remain in the event chat to observe and participate in the conversation even if you can’t attend the event itself, but perhaps we could ask whether you want to leave the event channel too when changing to Not Going.
For now, I will move this to Contribute > Feature.