SemEval-2019 Task 10: Math Question Answering
SemEval-2019 Task 10: Math Question Answering
复制标题
SemEval-2019 任务 10：数学问答
DOI：
10.18653/v1/s19-2153
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
Rik Koncel
中科院分区：
文献类型：
--
作者：
Mark Hopkins;Ronan Le Bras;Cristian Petrescu;Gabriel Stanovsky;Hannaneh Hajishirzi;Rik Koncel
我们报告了SemEval 2019数学问题回答任务。我们提供了一个来自数学SAT练习考试的问题集，包括2778个训练题和1082个测试题。对于这些问题的重要子集，我们还提供了SMT-LIB逻辑形式注释和可以解决这些逻辑形式的解释器。根据正确回答问题的百分比对系统进行评价。顶级系统正确回答了45%的测试问题，比17%的随机猜测基线有了相当大的提高。
We report on the SemEval 2019 task on math question answering. We provided a question set derived from Math SAT practice exams, including 2778 training questions and 1082 test questions. For a significant subset of these questions, we also provided SMT-LIB logical form annotations and an interpreter that could solve these logical forms. Systems were evaluated based on the percentage of correctly answered questions. The top system correctly answered 45% of the test questions, a considerable improvement over the 17% random guessing baseline.