That is not sufficient to completely disable many plugins. You need to comment them out in your app.yml and rebuild.
That’s going to be a problem, but likely isn’t yet.
Are you running multisite?
Do you have the old chat plugin installed (it has now been merged into core).
You should include the list of plugins that you’re using.