Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection

Yihang Tao (City University of Hong Kong) · Yuguang Fang (City University of Hong Kong) · Shengfeng He (Singapore Management University) · Yu Guo (City University of Hong Kong) · Yuxu Lu (Hong Kong Polytechnic University) · Haonan An · Huilin Zhu (Wuhan University of Technology) · Jingxian Liu (Wuhan University of Technology)
annotated maritime dataattribute-correlated active samplingbidirectional object-water attention moduleboundary interactionsdetection accuracydownstream tasking performancegeneralizationgenerative maritime learningmaritime generation datasetmaritime object detectionmulti-modality-conditioned generative modelsemantic conditionssynthetic data generationtask-aware sample selectionvisual fidelity

Maritime object detection is essential for navigation safety, surveillance, and autonomous operations, yet constrained by two key challenges: the scarcity of annotated maritime data and poor generalization across various maritime attributes (e.g., object category, viewpoint, location, and imaging environment). To address these challenges, we propose Neptune-X, a data-centric generative-selection framework that enhances training effectiveness by leveraging synthetic data generation with task-aware sample selection. From the generation perspective, we develop X-to-Maritime, a multi-modality-conditioned generative model that synthesizes diverse and realistic maritime scenes. A key component is the Bidirectional Object-Water Attention module, which captures boundary interactions between objects and their aquatic surroundings to improve visual fidelity. To further improve downstream tasking performance, we propose Attribute-correlated Active Sampling, which dynamically selects synthetic samples based on their task relevance. To support robust benchmarking, we construct the Maritime Generation Dataset, the first dataset tailored for generative maritime learning, encompassing a wide range of semantic conditions. Extensive experiments demonstrate that our approach sets a new benchmark in maritime scene synthesis, significantly improving detection accuracy, particularly in challenging and previously underrepresented settings. The code is available at https://github.com/gy65896/Neptune-X.