MeT: mesh transformer with an edge

MeT: mesh transformer with an edge
复制标题

DOI:
10.1007/s00371-023-02966-z
复制
发表时间:
2023-07
期刊:
The Visual Computer
影响因子:
--
通讯作者:
Pengwei Zhou;Xiaopan Dong;Juan Cao;Zhonggui Chen
Pengwei Zhou;Xiaopan Dong;Juan Cao;Zhonggui Chen
中科院分区:
其他
文献类型:
--
作者:
Pengwei Zhou;Xiaopan Dong;Juan Cao;Zhonggui Chen

文献摘要

相似文献

Transformers have been widely applied in various vision tasks processing different data, such as images, videos and point clouds. However, the use of transformers in 3D mesh analysis remains largely unexplored. To address this gap, we propose a mesh transformer (MeT) that utilizes local self-attention on edges. MeT is based on a transformer layer that uses vector attention for edges, which is a kind of attention operator that supports adaptive modulation to both feature vectors and individual feature channels. Based on the transformer block, we build a lightweight mesh transformer network that consists of encoder and decoder. MeT provides general backbones for subsequent 3D mesh analysis tasks. To evaluate the effectiveness of our network MeT, we conduct experiments on two classic mesh analysis tasks: shape classification and shape segmentation. MeT achieves the state-of-the-art performance on multiple datasets for two tasks. We also conduct ablation studies to show the effectiveness of key designs in our network.