Gestures or signs?Comparing manual and non-manual constructions sharing the same form in co-speech gesture and sign language: a corpus-driven approach. (GeSi)

有许多手动和非手动结构不仅限于手语，在共同语音手势中也可以观察到它们。本项目将系统地处理以下形式：掌心向上、抛开、指向、列出浮标、扬眉和身体侧倾。虽然对其中一些选定的结构进行了研究，但其他形式仍未得到研究，并且手语者和说话者之间的所有这些结构没有进行精细的比较。该项目填补了这一空白。它的目的是对共同语音手势和手势中选定的结构提供基于语料库的详细分析。目标是确定手语中的这些结构在功能和构成方面与手势中的类似形式有何不同以及在何种程度上有所不同。由于这些结构共享相同的模态，因此它们将得到相同的理论处理，并将沿着许多不同的维度进行研究，模糊严格的手势-符号二元关系，并支持对这些手动和非手动活动的理解，形成一个跨模态的连续体，沿着该连续体发生功能约定化和词汇化。该项目区分了视觉传达的两个主要例子——符号和手势，还提供了对不同渠道的交互以及这种交互背后的语法系统的进一步见解，有助于建立一种新的无模态的语言和沟通综合理论模型。

There is a number of manual and non-manual constructions which are not constrained to signed language only, they are also observed in co-speech gesture. The following forms will be systematically treated in this project: palm-up, throw away, pointing, list buoys, eyebrow raise and sidewards body leans. While some of these selected constructions have been researched, other forms remain un(der)studied and there is no fine-graded comparison of all these constructions between signers and speakers. This project fills this gap. It aims at providing a detailed corpus-based analysis of the selected constructions in both co-speech gesture and sign. The goal is to determine how – and to what degree – these constructions in sign language differ from comparable forms in gesture on both functional and formation grounds. As these constructions share the same modality, they will be given the same theoretical treatment and will be investigated along a number of various dimensions blurring the strict gesture-sign binary and backing the understanding of these manual and non-manual activities as forming a cross-modal continuum along which functional conventionalization and lexicalization takes place. Distinguishing signs and gesture, the two prime examples of visual communication, this project also provides further insights into the interaction of different channels and the grammatical system(s) underlying this interaction contributing to a new modality-free comprehensive theoretical model of language and communication.