EAGER: Collaborative Research: Spatiotemporal transfer learning for enabling cross-country and cross-hemisphere in-season crop mapping

EAGER：协作研究：时空迁移学习，用于实现跨国和跨半球的当季作物绘图

• 批准号: 2228000
• 负责人: Liping Di
• 金额: $ 25万
• 依托单位: George Mason University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2228000&HistoricalAwards=false
• 关键词: EAGER; Collaborative; Research; Spatiotemporal; transfer

Crop production is a major industry in the United States (U.S.). In 2021, the U.S. grain export accounted for over 40% share of international grain trade. Millions of U.S. farmers depend on international market for living and prosperity. However, the U.S. grain export is not only facing tough competition from other export countries, but also impacted by grain yield in import countries. In order to gain the competitive edge, stakeholders need to know as early as possible where and how many acres each type of crops that have been planted in a growing season around the world so that yield can be estimated, production and demand balance can be assessed, and grain prices can be predicted. This requires generating in-season crop maps of both U.S. and foreign countries. The classic method to generate in-season crop maps needs a large amount of verified information on crops (i.e., ground truths) to train algorithms for classifying in-season satellite remote sensing images. However, it is difficult or even impossible to obtain ground truths in foreign countries, particularly in early season. This study proposes to develop a spatiotemporally transferable machine-learning algorithm which will be trained with U.S. data and applied to in-season satellite remote sensing images of foreign countries for creating the in-season crop maps of the countries. Success of this project will make the in-season crop mapping of foreign countries possible. The project will significantly enhance the competitiveness and profitability of U.S. agriculture, increase the food security of the world, and potentially bring billions-of-dollars economic benefits to U.S. farmers.Satellite remote sensing with ground truth tagging is the current practice for crop mapping. However, it suffers from two problems: 1) Unavailability of ground truth in foreign countries; 2) Spatiotemporal intransferability of trained classifiers. This study will design spatiotemporally transferable learning algorithm and temporal learning strategy that would maximally transfer label data and models from U.S. to foreign countries. The proposed method utilizes adversarial training and contrastive learning. Through this two-player game, the feature extractor produces domain-invariant features. A classifier trained on this domain-invariant representation can transfer its model to a new domain because the target features match those seen during training, thus bridging the gap between times and locations. The U.S. trained algorithm will be tested in Canada and Brazil to demonstrate its cross-country and cross-hemisphere transferability. Scientifically this project will advance landcover science in in-season crop mapping by offering a novel method of transfer learning, advance machine learning in unsupervised domain adaptation across both space and time, and offer new methods to derive spatiotemporally invariant features from time-series remote sensing images. Socioeconomically this project will enhance competitiveness and profitability of U.S. agriculture, increase food security of the world, and potentially bring billions-of-dollars benefits to U.S. farmers.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

农作物生产是美国的主要产业。 2021年，美国粮食出口占国际粮食贸易份额超过40%。数百万美国农民依赖国际市场谋生和繁荣。然而，美国粮食出口不仅面临其他出口国的激烈竞争，还受到进口国粮食产量的影响。为了获得竞争优势，利益相关者需要尽早了解世界各地在生长季节种植的每种作物的种植地点和面积，以便估算产量、评估生产和需求平衡以及预测粮食价格。这需要生成美国和外国的当季作物地图。生成当季作物地图的经典方法需要大量经过验证的作物信息（即地面事实）来训练对当季卫星遥感图像进行分类的算法。然而，在国外，尤其是在季节初期，很难甚至不可能获得真实情况。这项研究建议开发一种时空可迁移的机器学习算法，该算法将使用美国数据进行训练，并应用于外国的当季卫星遥感图像，以创建这些国家的当季作物地图。该项目的成功将使国外当季作物测绘成为可能。该项目将显着提高美国农业的竞争力和盈利能力，提高世界粮食安全，并有可能为美国农民带来数十亿美元的经济利益。带有地面实况标记的卫星遥感是目前农作物测绘的做法。然而，它存在两个问题：1）国外无法获得真实数据； 2）经过训练的分类器的时空不可转移性。这项研究将设计时空可迁移学习算法和时间学习策略，最大限度地将标签数据和模型从美国转移到国外。所提出的方法利用对抗性训练和对比学习。通过这个两人游戏，特征提取器产生域不变特征。在这种域不变表示上训练的分类器可以将其模型转移到新域，因为目标特征与训练期间看到的特征相匹配，从而弥合了时间和位置之间的差距。美国训练的算法将在加拿大和巴西进行测试，以展示其跨国和跨半球的可转移性。从科学角度来看，该项目将通过提供一种新颖的迁移学习方法，推进当季作物制图中的土地覆盖科学，推进跨空间和时间的无监督域适应的机器学习，并提供从时间序列遥感图像中获取时空不变特征的新方法。从社会经济角度来看，该项目将提高美国农业的竞争力和盈利能力，增强世界粮食安全，并有可能为美国农民带来数十亿美元的利益。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Enhancing USDA NASS Cropland Data Layer with Segment Anything Model

• DOI: 10.1109/agro-geoinformatics59224.2023.10233404
• 发表时间: 2023-07
• 期刊: 2023 11th International Conference on Agro-Geoinformatics (Agro-Geoinformatics)
• 作者: Chen Zhang;Purva Marfatia;Hamza Farhan;L. Di;Li Lin;Haoteng Zhao;Hui Li;Md Didarul Islam;Zhengwei Yang

A Review of Remote Sensing in Sugarcane Mapping

• DOI: 10.1109/agro-geoinformatics59224.2023.10233506
• 发表时间: 2023-07
• 期刊: 2023 11th International Conference on Agro-Geoinformatics (Agro-Geoinformatics)
• 作者: Hui Li;L. Di;Chen Zhang;Li Lin;Liying Guo;Haoteng Zhao;Claire Guo;Ryan Hong

Prediction of Crop Planting Map Using One-dimensional Convolutional Neural Network and Decision Tree Algorithm

利用一维卷积神经网络和决策树算法预测农作物种植图

• DOI: 10.1109/agro-geoinformatics59224.2023.10233466
• 发表时间: 2023
• 期刊: 2023 11th International Conference on Agro-Geoinformatics (Agro-Geoinformatics
• 作者: Li, Hui;Di, Liping;Zhang, Chen;Lin, Li;Guo, Liying;Zhao, Haoteng
• 通讯作者: Zhao, Haoteng