Efficient Knowledge Transfer in Federated Recommendation for Joint Venture Ecosystem

Cheng Wang (Huawei Technologies Ltd.) · Yi Wang (Beijing University of Posts and Telecommunications) · Yichen Li (Huazhong University of Science and Technology) · YI LIU (Chongqing Ant Consumer Finance Co,. Ltd) · wangshi.ww (Chongqing Ant Consumer Finance Co,. Ltd) · Haozhao Wang (The Hong Kong Polytechnic University) · Ruixuan Li (Huazhong University of Science and Technology) · Yijing Shan (Huazhong University of Science and Technology)
aggregated global preferencebridge functionfederated recommendation systemfederated trainingiot devicesitem embeddingjoint venture ecosystemlocal dataset transformationmodel inversion techniquesprediction accuracyprivacy enhancementrating preferencestate-of-the-art methodsuser information complexityuser matchinguser privacy guarantee

The current Federated Recommendation System (FedRS) focuses on personalized recommendation services and assumes clients are personalized IoT devices (e.g., Mobile phones). In this paper, we deeply dive into new but practical FedRS applications within the joint venture ecosystem. Subsidiaries engage as participants with their users and items. However, in such a situation, merely exchanging item embedding is insufficient, as user bases always exhibit both overlaps and exclusive segments, demonstrating the complexity of user information. Meanwhile, directly uploading user information is a violation of privacy and unacceptable. To tackle the above challenges, we propose an efficient and privacy-enhanced federated recommendation for the joint venture ecosystem (FR-JVE) that each client transfers more common knowledge from other clients with a distilled user's \textit{rating preference} from the local dataset. More specifically, we first transform the local data into a new format and apply model inversion techniques to distill the rating preference with frozen user gradients before the federated training. Then, a bridge function is employed on each client side to align the local rating preference and aggregated global preference in a privacy-friendly manner. Finally, each client matches similar users to make a better prediction for overlapped users. From a theoretical perspective, we analyze how effectively FR-JVE can guarantee user privacy. Empirically, we show that FR-JVE achieves superior performance compared to state-of-the-art methods.