PhishAR: Using Augmented Reality to help users make better security decisions

计算机用户必须反复决定是信任收到的电子邮件，还是将其视为网络钓鱼企图。知识渊博的用户开发了各种网络钓鱼检测机制：他们检测意外的拼写错误，发现可疑的紧急情绪，或者检查发件人的电子邮件域与他们声称的身份之间的不匹配。虽然这些细微差别对于非专业用户来说很复杂，但它们可以通过机器学习模型实现自动化。我们正在开发一个基于增强现实的安全助手：一个移动设备系统，它使用计算机视觉和机器学习技术以及现代智能手机和耳机的沉浸式增强现实功能，通过查看其他设备的屏幕并指导他们如何使用它们，来监督并为非专业用户提供无缝的安全指导。更具体地说，在收到电子邮件后，我们的解决方案允许用户用他们的手机扫描它，并收到电子邮件是欺诈性网络钓鱼企图的可能性的估计，以及关于为什么做出这样的结论的交互式解释。

Computer users must repeatedly decide whether to trust a received email or to consider it a phishing attempt. Knowledgeable users develop various phishing detection mechanisms: they detect unexpected spelling mistakes, spot suspiciously urgent sentiment, or check for mismatches between the sender's email domain and their claimed identity.These nuances, while complex for non-expert users to learn, lend themselves to being automated by machine learning models. We are working on an augmented reality based security assistant: a mobile device system that uses computer vision and machine learning techniques together with immersive AR capabilities of modern smartphones and headsets to supervise and provide seamless security guidance to non-expert users by looking at the screens of other devices and instructing them on how to use them.More specifically, after an email is received, our solution allows the user to scan it with their mobile phone and receive an estimate of the likelihood of the email being a fraudulent phishing attempt, together with interactive explanations as to why such a conclusion was made.