You cannot safely “downgrade” a Discourse instance because migrations might have run and manually picking those apart is a complete waste of your time and not supported.
Only the current version of stable is supported so you are best just to upgrade to 3.2.3 and stick with it?