Do Hand Gestures Increase Prominence in Naturally Produced Utterances?

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

Standard

Do Hand Gestures Increase Prominence in Naturally Produced Utterances? / Paggio, Patrizia; Vella, Alexandra; Mitterer, Holger; Attard, Greta.

I: Language and Cognition, 2023.

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

Harvard

Paggio, P, Vella, A, Mitterer, H & Attard, G 2023, 'Do Hand Gestures Increase Prominence in Naturally Produced Utterances?', Language and Cognition.

APA

Paggio, P., Vella, A., Mitterer, H., & Attard, G. (2023). Do Hand Gestures Increase Prominence in Naturally Produced Utterances?. Manuskript afsendt til publicering

Vancouver

Paggio P, Vella A, Mitterer H, Attard G. Do Hand Gestures Increase Prominence in Naturally Produced Utterances? Language and Cognition. 2023.

Author

Paggio, Patrizia ; Vella, Alexandra ; Mitterer, Holger ; Attard, Greta. / Do Hand Gestures Increase Prominence in Naturally Produced Utterances?. I: Language and Cognition. 2023.

Bibtex

@article{7efc8fe9e5b9467395f4ee96bde72c22,
title = "Do Hand Gestures Increase Prominence in Naturally Produced Utterances?",
abstract = "This study investigates the contribution of hand gestures to the perception of prominence in naturally occurring stimuli extracted from a multimodal corpus of Maltese conversations. Experiment participants had to rate the prominence of target words in sentences that were presented to them as audiovisual and audio-only stimuli. In half of the stimuli, the target word was accompanied by a co-speech hand gesture. The results of the experiment show that the presence of a co-speech gesture increases the perceived prominence of a target word. How- ever, although seeing the speaker produce the gesture increases the perceived prominence of the co-occurring word, it does not so in a statistically significant way. A post-hoc acoustic analysis of the data showed that on average, prominent words tend to have higher intensity when they are accompanied by gestures than when they are not. The study concludes that gestures may provide an additional but not necessary cue to prominence for the listener.",
author = "Patrizia Paggio and Alexandra Vella and Holger Mitterer and Greta Attard",
year = "2023",
language = "English",
journal = "Language and Cognition",
issn = "1866-9808",
publisher = "Cambridge University Press",

}

RIS

TY - JOUR

T1 - Do Hand Gestures Increase Prominence in Naturally Produced Utterances?

AU - Paggio, Patrizia

AU - Vella, Alexandra

AU - Mitterer, Holger

AU - Attard, Greta

PY - 2023

Y1 - 2023

N2 - This study investigates the contribution of hand gestures to the perception of prominence in naturally occurring stimuli extracted from a multimodal corpus of Maltese conversations. Experiment participants had to rate the prominence of target words in sentences that were presented to them as audiovisual and audio-only stimuli. In half of the stimuli, the target word was accompanied by a co-speech hand gesture. The results of the experiment show that the presence of a co-speech gesture increases the perceived prominence of a target word. How- ever, although seeing the speaker produce the gesture increases the perceived prominence of the co-occurring word, it does not so in a statistically significant way. A post-hoc acoustic analysis of the data showed that on average, prominent words tend to have higher intensity when they are accompanied by gestures than when they are not. The study concludes that gestures may provide an additional but not necessary cue to prominence for the listener.

AB - This study investigates the contribution of hand gestures to the perception of prominence in naturally occurring stimuli extracted from a multimodal corpus of Maltese conversations. Experiment participants had to rate the prominence of target words in sentences that were presented to them as audiovisual and audio-only stimuli. In half of the stimuli, the target word was accompanied by a co-speech hand gesture. The results of the experiment show that the presence of a co-speech gesture increases the perceived prominence of a target word. How- ever, although seeing the speaker produce the gesture increases the perceived prominence of the co-occurring word, it does not so in a statistically significant way. A post-hoc acoustic analysis of the data showed that on average, prominent words tend to have higher intensity when they are accompanied by gestures than when they are not. The study concludes that gestures may provide an additional but not necessary cue to prominence for the listener.

M3 - Journal article

JO - Language and Cognition

JF - Language and Cognition

SN - 1866-9808

ER -

ID: 334399859