T-RES: TEST OF RATING OF EMOTIONS IN SPEECH: INTERACTION OF AFFECTIVE CUES EXPRESSED IN LEXICAL CONTENT AND PROSODY OF SPOKEN SENTENCES

  • B. M. Ben-David
  • N. Multani
  • N. A-M. Durham
  • F. Rudzicz
  • P. H. H. M. Van Lieshout

Abstract

When the sentence „I am so happy‟ is spoken in an angry prosody (i.e., tone of voice), is it interpreted as happiness or anger? This portrays the complex interaction of the two dimensions that convey emotion in speech: lexical content and prosody. How is each dimension weighed perceptually? Is the rating of one impacted by the other? We present a comprehensive paradigm that examines the interplay between these two dimensions. Fifty lexical sentences, reliably associated with one of five emotions (anger, fear, sadness, happiness and neutral), were recorded spoken in five distinct prosodies. The stimulus-set was comprised of two samples for each combination of dimensions, creating congruent and incongruent pairings in addition to neutral spoken sentences. Sixty-four participants were asked to rate the degree to which each spoken sentence expressed each emotion in the lexical content, prosody or both. Results show that “processing strategies†for integrating lexical and prosodic dimensions were dependent on the nature of the rated emotion.

Author Biographies

B. M. Ben-David
N. A-M. Durham

 

Section
Full Articles