Quantization

concepts · 2 notes linked

Related: Google · Lm Studio · Unsloth · Fine Tuning · Tool Calling · GPT Oss · Llama Cpp · Whisper

Notes

• How to fine-tune FunctionGemma and run it locally — Fine-tuning Google's 270M FunctionGemma locally with Unsloth
• I'm running a 120B local LLM on 24GB of VRAM, and now it powers my smart home — Running gpt-oss-120b locally on 24GB VRAM via MoE