Less but More: Linear Adaptive Graph Learning Empowering Spatiotemporal Forecasting

Yang Wang (Concordia University) · Jiaming Ma (University of Science and Technology of China) · Binwu Wang (University of Science and Technology of China) · Guanjun Wang (University of Science and Technology of China) · Kuo Yang (University of Science and Technology of China) · Zhengyang Zhou (University of Science and Technology of China) · Pengkun Wang (University of Science and Technology of China) · Xu Wang (Shanghai Jiao Tong University)
adaptive graph learningadaptive graph representationsbalancing mechanismcomputational complexityedge-level noiseexpressive capacitygraph convolutiongraph topology learningkernel-based functionslinear complexitynode interactionrelu activation functionsparse mixture-of-expertsspatiotemporal forecastingspatiotemporal graph neural networks

The effectiveness of Spatiotemporal Graph Neural Networks (STGNNs) critically hinges on the quality of the underlying graph topology. While end-to-end adaptive graph learning methods have demonstrated promising results in capturing latent spatiotemporal dependencies, they often suffer from high computational complexity and limited expressive capacity. In this paper, we propose MAGE for efficient spatiotemporal forecasting. We first conduct a theoretical analysis demonstrating that the ReLU activation function employed in existing methods amplifies edge-level noise during graph topology learning, thereby compromising the fidelity of the learned graph structures. To enhance model expressiveness, we introduce a sparse yet balanced mixture-of-experts strategy, where each expert perceives the unique underlying graph through kernel-based functions and operates with linear complexity relative to the number of nodes. The sparsity mechanism ensures that each node interacts exclusively with compatible experts, while the balancing mechanism promotes uniform activation across all experts, enabling diverse and adaptive graph representations. Furthermore, we theoretically establish that a single graph convolution using the learned graph in MAGE is mathematically equivalent to multiple convolutional steps under conventional graphs. We evaluate MAGE against advanced baselines on multiple real-world spatiotemporal datasets. MAGE achieves competitive performance while maintaining strong computational efficiency.