The first small model for honest conversation
Until now, GPT-4o was the only AI model I could have a conversation with on equal terms. I used it extensively for self-reflection. With GPT-5, that was no longer possible. It was too tame and too proper. Small, local models were too clunky. With this one (Gemma 4 31B), I finally have back the tool I’ve been missing. Without subscription. Locally, on my little RTX 3090.
Huge thanks to Google!
Nice, sounds fantastic!
You did not like Qwen ?
Yes, Qwen 3.5 27B is a very powerful model! But it’s not enough for me when it comes to critical self-reflection.
Hi @ghostwithahat ,
Thanks for sharing your feedback! We are glad to hear that google/gemma-4-31B-it is giving you the conversational experience you have been looking for, and that it works well locally on your setup.