billion-parameter models

3 papers

• DuoGPT: Training-free Dual Sparsity through Activation-aware Pruning in LLMs
• Mixtures of Subspaces for Bandwidth Efficient Context Parallel Training
• TSENOR: Highly-Efficient Algorithm for Finding Transposable N:M Sparse Masks