Edge Inference

concepts · 1 notes linked

Related: Deepseek · Nvidia · Large Language Models · Model Distillation

Notes

• Tiny DeepSeek 1.5B Models Run on $249 NVIDIA Jetson Nano | NextBigFuture.com — DeepSeek R1 1.5B distilled model runs locally on sub-$250 edge hardware