communication efficiency
Communication efficiency in AI refers to the effectiveness and speed of data transfer between components of a system, which is crucial for tasks like distributed learning and multi-agent systems.
- Adaptive LoRA Experts Allocation and Selection for Federated Fine-Tuning
- Efficient Adaptive Federated Optimization
- Layer-wise Update Aggregation with Recycling for Communication-Efficient Federated Learning
- Multiplayer Federated Learning: Reaching Equilibrium with Less Communication
- Revisiting 1-peer exponential graph for enhancing decentralized learning efficiency
- Revisiting Consensus Error: A Fine-grained Analysis of Local SGD under Second-order Data Heterogeneity
- Subspace Networks: Scaling Decentralized Training with Communication-Efficient Model Parallelism
- Tensor-Parallelism with Partially Synchronized Activations
- You Only Communicate Once: One-shot Federated Low-Rank Adaptation of MLLM