Two T4 is way too little for that model. You can try something like a prompt compatible 7B model in those.
2 Me gusta
Two T4 is way too little for that model. You can try something like a prompt compatible 7B model in those.