I can’t reproduce this exact screenshot on my iPad. I can switch between the floating and full keyboards and that preference is saved by the OS. It works fine with the latest beta of the app.
It’s a slightly different UI for me though:
What version of iPadOS are you on?