Multimodal Deep Learning for Heterogeneous GNSS-R Data Fusion and Ocean Wind Speed Retrieval
Multimodal Deep Learning for Heterogeneous GNSS-R Data Fusion and Ocean Wind Speed Retrieval
复制标题
DOI：
10.1109/jstars.2020.3010879
复制
发表时间：
2020
影响因子：
5.5
通讯作者：
Xiaohan Chu;Jie He;Hongqing Song;Yue Qi;Yueqiang Sun;W. Bai;Wei Li;Qiwu Wu
中科院分区：
文献类型：
--
作者：
Xiaohan Chu;Jie He;Hongqing Song;Yue Qi;Yueqiang Sun;W. Bai;Wei Li;Qiwu Wu
原始输入数据的全面性和特征工程的有效性是影响机器学习性能的两个关键因素。为了提高全球导航卫星系统反射测量（GNSS-R）海洋风速反演的数据全面性，本文引入了一种新的输入数据结构，该结构由延迟多普勒图（DDM）和所有卫星接收器状态（SRS）参数组成。然后，为了克服手工特征工程的困难并有效融合DDM和SRS的信息，我们提出了一种异构多模态深度学习（HMDL）方法，根据输入数据的异构性来反演风速。通过对 TDS-1 获得的实际数据集的性能评估来验证所提出的模型。新的输入数据结构将平均绝对误差 (MAE) 的预测精度提高了 13.5% 到 30.7%，将均方根误差 (RMSE) 的预测精度提高了 10.6% 到 29.5%。 HMDL 将 MAE 的预测精度提高了 7.7%，将 RMSE 的预测精度提高了 7.1%。与传统的基于神经网络的解决方案相比，整个提出的解决方案的 MAE 预测精度提高了 36.3%，RMSE 提高了 36.8%。结果清楚地表明，新的输入数据结构和HMDL的引入有效地提高了GNSS-R风速反演的准确性和鲁棒性。
The comprehensiveness of the raw input data and the effectiveness of feature engineering are two key factors affecting the performance of machine learning. To improve the data comprehensiveness for Global Navigation Satellite System Reflectometry (GNSS-R) ocean wind speed retrieval, this article introduces a new input data structure, which is composed of Delay–Doppler maps (DDM) and all satellite receiver status (SRS) parameters. Then, to overcome the difficulty of handcrafted feature engineering and effectively fusion the information of DDM and SRS, we presented a heterogeneous multimodal deep learning (HMDL) method to retrieve the wind speed according to the heterogeneity of the input data. The proposed model is verified by the performance evaluation of realistic data sets obtained from TDS-1. The new input data structure improves the prediction accuracy at 13.5% to 30.7% on mean absolute error (MAE) at 10.6% to 29.5% on the root mean square error (RMSE). The HMDL improves the prediction accuracy at 7.7% on MAE and 7.1% on RMSE. The whole proposed solution improves the prediction accuracy at 36.3% on MAE and 36.8% on RMSE, comparing with the traditional neural network-based solution. The results clearly show that both the introduction of the new input data structure and HMDL effectively improve the accuracy and robustness of GNSS-R wind speed retrieval.