activation sparsity

3 papers

• Activity Pruning for Efficient Spiking Neural Networks
• DuoGPT: Training-free Dual Sparsity through Activation-aware Pruning in LLMs
• Spark Transformer: Reactivating Sparsity in Transformer FFN and Attention