tensor parallelism

3 papers

• EasySpec: Layer-Parallel Speculative Decoding for Efficient Multi-GPU Utilization
• First Attentions Last: Better Exploiting First Attentions for Efficient Parallel Training
• Synergistic Tensor and Pipeline Parallelism