Llama

entities · 3 notes linked

Related: Large Language Models · Meta · Model Quantization · Stanford · Georgi Gerganov · Open Source AI · Instruction Fine Tuning · Post Training Quantization

Notes

• Hugging Face Introduces StackLLaMA: A 7B Parameter Language Model Based on LLaMA and Trained on Data from Stack Exchange Using RLHF — Hugging Face RLHF fine-tuning of LLaMA 7B on Stack Exchange Q&A data
• The Trick to Make LLaMa Fit into Your Pocket: Meet OmniQuant, an AI Method that Bridges the Efficiency and Performance of LLMs — OmniQuant learnable post-training quantization achieves low-bit LLM compression efficiently
• Why LLaMa Is A Big Deal — LLaMA enables GPT-3-class LLM inference on consumer hardware