Invitational Workshop on Information Retrieval Tools

信息检索（IR）研究涉及计算机程序来组织，分类，检索，评估和显示数据库和搜索结果。IR领域有着在严格定义的测试环境中进行严格评估的悠久历史。然而，目前的趋势是更现实的测试环境，更大的数据库，更复杂的搜索引擎，并评估人类系统对搜索过程的贡献。本次研讨会的重点是开始开发一个程序、环境和任务的工具包，供研究人员广泛使用。该工具包的目标是为比较不同群体在不同情况下的研究提供一个更加统一的基础。研讨会的演讲致力于确定可用的工具，其局限性，以及当前和未来研究的需求。将把较小工作组的报告纳入一项计划，指导在不久的将来开发工具包。有关研讨会和研讨会报告的更多信息，请访问http://www.pitt.edu/~korfhage/ir-tools.html。

Information Retrieval (IR) research involves computer programs to organize, classify, retrieve, evaluate, and display databases and search results. The IR field has a long history of rigorous evaluation in narrowly defined test environments. However, the current trend is toward more realistic test environments with larger databases, more sophisticated search engines, and evaluation of the human-system contribution to the search process. The focus of this workshop is to begin development of a toolkit of programs, environments, and tasks to be made widely available to researchers. The goal of the toolkit is to provide a more uniform basis for comparison of research by different groups and under different circumstances. Workshop presentations are devoted to identifying the available tools, their limitations, and the needs of current and future research. Reports from smaller working groups are to be integrated into a plan that will guide toolkit development in the near future. Furter information about the workshop and the workshop reports is available at http://www.pitt.edu/~korfhage/ir-tools.html.