CSLI Publications logo
new books
catalog
series
contact us
for authors
order
search
CSLI Publications
Facebook
 

Alahverdzhieva, Katya & Lascarides, Alex: An HPSG Approach to Synchronous Speech and Deixis

The use of hand gestures to point at objects and individuals, or to navigate through landmarks on a virtually created map is ubiquitous in face-to-face conversation. We take this observation as a starting point, and we demonstrate that deictic gestures can be analysed on a par with speech by using standard methods from constraint-based grammars such as HPSG. In particular, we use the form of the deictic signal, the form of the speech signal (including its prosodic marking) and their relative temporal performance to derive an integrated multimodal tree that maps to an integrated multimodal meaning. The integration process is constrained via construction rules that rule out ill-formed input. These rules are driven from an empirical corporal study which sheds light on the interaction between speech and deictic gesture.


Maintained by Stefan Müller

Created: November 16, 2011
Last modified: January 09, 2019

pubs @ csli.stanford.edu