Two T4 is way too little for that model. You can try something like a prompt compatible 7B model in those.
2 Likes
Two T4 is way too little for that model. You can try something like a prompt compatible 7B model in those.