I-Corps: Automated As-is Facade Modeling of High-rise Buildings Using Drones and Artificial Intelligence

这个I-Corps项目的更广泛的影响/商业潜力是开发高层建筑表面检测技术。这项新技术是基于使用无人机和人工智能（AI）算法的自动化高层建筑立面建模技术的发展。该应用程序具有财务承诺，因为它解决了建筑基础设施的恶化问题。拟议的项目可以改善建筑物的检查、维护、翻新和维修，同时也可以教育和培训下一代技术工人。I-Corps项目基于使用无人机和人工智能（AI）算法开发的自动化高层建筑立面建模技术。首先，采用螺旋路径的无人机捕捉建筑物外部图像，摄影测量用于进行3D重建，并为扫描的建筑物立面创建网格模型。高分辨率的farade正射影由网格模型生成，并由AI模型进行像素分割。采用随机翻转、旋转、调整大小、透视变换和颜色调整等组合数据增强策略，进行少标签的模型训练。发达的技术可能会改变高层建筑立面的检测方式。遗失的立面图可以复制用于维护、翻新和修理操作。这项技术可以改善业主、设计公司、承包商、材料供应商和金融机构之间的沟通，同时加快设计、审批、融资、施工和检验过程。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact/commercial potential of this I-Corps project is the development of a high-rise building façade inspection technology. The new techology is based on the development of an automated, high-rise building façade modeling technology that uses drones and artificial intelligence (AI) algorithms. The application has financial promise because it addresses the deterioration of building infrastructure. The proposed project may improve building inspection, maintenance, renovation, and repair while also educating and training the next generation of skilled workers. This I-Corps project is based on the development of an automated, as-is, high-rise building façade modeling technology using drones and artificial intelligence (AI) algorithms. To begin, a drone with a spiral path is employed to capture building exterior images and photogrammetry is used to conduct 3D reconstructions and create mesh models for the scanned building façades. High-resolution façade orthoimages are generated from mesh models and pixelwise segmented by an AI model. A combined data augmentation strategy, including random flipping, rotation, resizing, perspective transformation and color adjustment, is utilized for model training with few labels. The developed technology may transform the way that high-rise building façades will be inspected. Missing façade drawings may be reproduced for maintenance, renovation, and repair operations. This technology may improve communication among building owners, design firms, contractors, material suppliers, and financial institutions while speeding up the design, approval, finance, construction and inspection processes.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.