GPT Oss

entities · 1 notes linked

Related: Llama Cpp · Whisper · Home Assistant · Openai · Proxmox · Mixture Of Experts · Local LLM Inference · Quantization

Notes

• I'm running a 120B local LLM on 24GB of VRAM, and now it powers my smart home — Running gpt-oss-120b locally on 24GB VRAM via MoE