A Fast and Accurate One-Stage Approach to Visual Grounding
A Fast and Accurate One-Stage Approach to Visual Grounding
复制标题
DOI：
10.1109/iccv.2019.00478
复制
发表时间：
2019-08
期刊：
影响因子：
--
通讯作者：
Zhengyuan Yang;Boqing Gong;Liwei Wang;Wenbing Huang;Dong Yu;Jiebo Luo
中科院分区：
文献类型：
--
作者：
Zhengyuan Yang;Boqing Gong;Liwei Wang;Wenbing Huang;Dong Yu;Jiebo Luo
我们提出了一个简单，快速，准确的一步视觉接地方法，灵感来自以下见解。现有的建议和排名两阶段方法的性能受到他们在第一阶段提出的区域候选人的质量的限制-如果没有候选人可以覆盖地面真实区域，那么在第二阶段就没有希望将正确的区域排名到顶部。为了避免这种警告，我们提出了一个单阶段模型，可以实现端到端的联合优化。其主要思想就像将文本查询嵌入到YOLOv 3对象检测器中一样简单，通过空间特征进行增强，以便考虑查询中的空间提及。尽管很简单，这种一阶段的方法显示出巨大的潜力，在准确性和速度方面的短语定位和指涉表达理解，根据我们的实验。鉴于这些结果沿着仔细调查一些流行的区域建议，我们主张视觉接地的范式转变，从传统的两阶段的方法，一个阶段的框架。
We propose a simple, fast, and accurate one-stage approach to visual grounding, inspired by the following insight. The performances of existing propose-and-rank two-stage methods are capped by the quality of the region candidates they propose in the first stage --- if none of the candidates could cover the ground truth region, there is no hope in the second stage to rank the right region to the top. To avoid this caveat, we propose a one-stage model that enables end-to-end joint optimization. The main idea is as straightforward as fusing a text query's embedding into the YOLOv3 object detector, augmented by spatial features so as to account for spatial mentions in the query. Despite being simple, this one-stage approach shows great potential in terms of both accuracy and speed for both phrase localization and referring expression comprehension, according to our experiments. Given these results along with careful investigations into some popular region proposals, we advocate for visual grounding a paradigm shift from the conventional two-stage methods to the one-stage framework.