A 16GB VRAM Fine-Tune of Gemma 4 12B Claims 2.7x Better Tool Calling and 15.7% More Tool Calls Attempted

r/LocalLLaMA (173 upvotes, 28 comments)·medium signalXBlueskyLinkedInCopy link

A builder fine-tuned Gemma 4 12B specifically for tool use and CLI work because nothing larger fits comfortably in 16 GB of VRAM, reporting a 2.7x improvement on tool calling plus a 15.7% rise in the number of tool calls the model tries to emit, which they read as less time lost in reasoning. Weights are published fp16 through Q4_K_M for llama.cpp and Ollama at huggingface.co/TheOneWhoWill/Coding-Monkey-Gemma-GGUF. Tested attached to GitHub Copilot, it correctly sequenced npm installs after create-next-app; the author notes Q6 and above are noticeably better if you have the VRAM.