Mirroring and Prediction of Gestures from Interlocutor’s Behavior

Publikation: Bidrag til bog/antologi/rapport › Bidrag til bog/antologi › Forskning › fagfællebedømt

Standard

Mirroring and Prediction of Gestures from Interlocutor’s Behavior. / Navarretta, Costanza.

Cognitive Infocommunications, Theory and Applications. red. / Ryszard Klempous; Jan Nikodem; Péter Zoltán Baranyi. Cham : Springer, 2019. s. 91-107 (Topics in Intelligent Engineering and Informatics, Bind 13).

Publikation: Bidrag til bog/antologi/rapport › Bidrag til bog/antologi › Forskning › fagfællebedømt

Harvard

Navarretta, C 2019, Mirroring and Prediction of Gestures from Interlocutor’s Behavior. i R Klempous, J Nikodem & PZ Baranyi (red), Cognitive Infocommunications, Theory and Applications. Springer, Cham, Topics in Intelligent Engineering and Informatics, bind 13, s. 91-107. https://doi.org/10.1007/978-3-319-95996-2_5

APA

Navarretta, C. (2019). Mirroring and Prediction of Gestures from Interlocutor’s Behavior. I R. Klempous, J. Nikodem, & P. Z. Baranyi (red.), Cognitive Infocommunications, Theory and Applications (s. 91-107). Springer. Topics in Intelligent Engineering and Informatics Bind 13 https://doi.org/10.1007/978-3-319-95996-2_5

Vancouver

Navarretta C. Mirroring and Prediction of Gestures from Interlocutor’s Behavior. I Klempous R, Nikodem J, Baranyi PZ, red., Cognitive Infocommunications, Theory and Applications. Cham: Springer. 2019. s. 91-107. (Topics in Intelligent Engineering and Informatics, Bind 13). https://doi.org/10.1007/978-3-319-95996-2_5

Author

Navarretta, Costanza. / Mirroring and Prediction of Gestures from Interlocutor’s Behavior. Cognitive Infocommunications, Theory and Applications. red. / Ryszard Klempous ; Jan Nikodem ; Péter Zoltán Baranyi. Cham : Springer, 2019. s. 91-107 (Topics in Intelligent Engineering and Informatics, Bind 13).

Bibtex

@inbook{0f2a7a530f1d440c99cef8a9e48cf06e,
title = "Mirroring and Prediction of Gestures from Interlocutor{\textquoteright}s Behavior",
abstract = "Mirroring and synchronization of non-verbal behavior is an important characteristics of human conduct also in communication. The aims of this paper are to analyze the occurrences of mirroring gestures, which comprise head movements, facial expressions, body postures and hand gestures, in first encounters and to determine whether information about the gestures of an individual can be used to predict the presence and the class of the gestures of the interlocutor. The contribution of related speech token is also investigated. The analysis of the encounters shows that 20–30% of the head movements, facial expressions and body postures are mirrored in the corpus, while there are only few occurrences of mirrored hand gestures. The latter are therefore not included in the prediction experiments. The results of the experiments, in which various machine learning algorithms have been applied, show that information about the shape and duration of the gestures of one participant contributes to the prediction of the presence and class of the gestures of the other participant, and that adding information about the related speech tokens in some cases improves the prediction performance. These results indicate that it is useful to take mirroring into account when designing and implementing cognitive aware info-communicative devices.",
author = "Costanza Navarretta",
year = "2019",
doi = "10.1007/978-3-319-95996-2_5",
language = "English",
isbn = "978-3-319-95995-5",
series = "Topics in Intelligent Engineering and Informatics",
publisher = "Springer",
pages = "91--107",
editor = "Klempous, {Ryszard } and Nikodem, {Jan } and Baranyi, {P{\'e}ter Zolt{\'a}n }",
booktitle = "Cognitive Infocommunications, Theory and Applications",
address = "Switzerland",

}

RIS

TY - CHAP

T1 - Mirroring and Prediction of Gestures from Interlocutor’s Behavior

AU - Navarretta, Costanza

PY - 2019

Y1 - 2019

N2 - Mirroring and synchronization of non-verbal behavior is an important characteristics of human conduct also in communication. The aims of this paper are to analyze the occurrences of mirroring gestures, which comprise head movements, facial expressions, body postures and hand gestures, in first encounters and to determine whether information about the gestures of an individual can be used to predict the presence and the class of the gestures of the interlocutor. The contribution of related speech token is also investigated. The analysis of the encounters shows that 20–30% of the head movements, facial expressions and body postures are mirrored in the corpus, while there are only few occurrences of mirrored hand gestures. The latter are therefore not included in the prediction experiments. The results of the experiments, in which various machine learning algorithms have been applied, show that information about the shape and duration of the gestures of one participant contributes to the prediction of the presence and class of the gestures of the other participant, and that adding information about the related speech tokens in some cases improves the prediction performance. These results indicate that it is useful to take mirroring into account when designing and implementing cognitive aware info-communicative devices.

AB - Mirroring and synchronization of non-verbal behavior is an important characteristics of human conduct also in communication. The aims of this paper are to analyze the occurrences of mirroring gestures, which comprise head movements, facial expressions, body postures and hand gestures, in first encounters and to determine whether information about the gestures of an individual can be used to predict the presence and the class of the gestures of the interlocutor. The contribution of related speech token is also investigated. The analysis of the encounters shows that 20–30% of the head movements, facial expressions and body postures are mirrored in the corpus, while there are only few occurrences of mirrored hand gestures. The latter are therefore not included in the prediction experiments. The results of the experiments, in which various machine learning algorithms have been applied, show that information about the shape and duration of the gestures of one participant contributes to the prediction of the presence and class of the gestures of the other participant, and that adding information about the related speech tokens in some cases improves the prediction performance. These results indicate that it is useful to take mirroring into account when designing and implementing cognitive aware info-communicative devices.

U2 - 10.1007/978-3-319-95996-2_5

DO - 10.1007/978-3-319-95996-2_5

M3 - Book chapter

SN - 978-3-319-95995-5

T3 - Topics in Intelligent Engineering and Informatics

SP - 91

EP - 107

BT - Cognitive Infocommunications, Theory and Applications

A2 - Klempous, Ryszard

A2 - Nikodem, Jan

A2 - Baranyi, Péter Zoltán

PB - Springer

CY - Cham

ER -

ID: 242615614