Proxmox

entities · 1 notes linked

Related: GPT Oss · Llama Cpp · Whisper · Home Assistant · Openai · Mixture Of Experts · Local LLM Inference · Quantization

Notes

• I'm running a 120B local LLM on 24GB of VRAM, and now it powers my smart home — Running gpt-oss-120b locally on 24GB VRAM via MoE