Handling Emotions in Human-Computer Dialogues 9789048131280, 9789048131297, 9048131286, 9048131294

Table of contents :
Cover......Page 1
6.2 Speech Data Used for the Emotion Recognizer Evaluation......Page 4
4.1.4 Prosodic and Acoustic Features......Page 7
Handling Emotions in Human-Computer Dialogues......Page 2
1.1.2 Natural Language Understanding......Page 3
Preface......Page 5
6.3 Performance of Our Emotion Recognizer......Page 6
Contents......Page 8
1.1.1 Automatic Speech Recognition......Page 11
1.1.5 Text-to-Speech......Page 14
6.3.2 Speech–Emotion Recognition......Page 16
2.3 Emotional Labeling......Page 18
2.4 Emotional Speech Databases/Corpora......Page 24
2.5 Discussion......Page 27
1 Introduction......Page 10
1.1.3 Dialogue Management......Page 13
1.2 Enhancing a Spoken Language Dialogue System......Page 15
4.2.2 Artificial Neural Networks......Page 19
1.4 Issues in User Modeling......Page 20
3.5 Integrating Emotions into Adaptive Dialogue Management......Page 26
3.6 A Semi-Stochastic Dialogue Model......Page 32
3.7 A Semi-Stochastic Emotional Model......Page 44
3.8 A Semi-Stochastic Combined Emotional Dialogue Model......Page 49
2.5 Discussion......Page 54
3.10 Discussion......Page 58
4.3 Existing Approaches to Emotion Recognition......Page 21
1.6 Summary of Contributions......Page 25
6.3.4 Emotion Recognition by Linguistic Analysis......Page 29
4.6 Combined Speech and Emotion Recognition......Page 36
4.7 Emotion Recognition by Linguistic Analysis......Page 38
4.8 Discussion......Page 43
5.2 Using Multiple (Speech–)Emotion Recognizers......Page 9
1.5 Evaluation of Dialogue Systems......Page 23
5.4 Discussion......Page 35
1.1.2 Natural Language Understanding......Page 12
2.2 Theories of Emotion and Categorization......Page 31
Index......Page 37
1.3 Challenges in Dialogue Management Development......Page 17
2.1 Definition of Emotion......Page 28
2.3 Emotional Labeling......Page 45
2.4 Emotional Speech Databases/Corpora......Page 51
3 Adaptive Human–Computer Dialogue......Page 55
3.1.1 Adaptive Dialogue Management......Page 56
3.1.2 Stochastic Approaches to Dialogue Modeling......Page 64
3.1.3 Emotions in Dialogue Systems......Page 67
3.2 User-State and Situation Management......Page 69
3.3 Dialogue Strategies and Control Parameters......Page 73
3.4 Integrating Speech Recognizer Confidence Measures into Adaptive Dialogue Management......Page 74
3.5 Integrating Emotions into Adaptive Dialogue Management......Page 80
3.6 A Semi-Stochastic Dialogue Model......Page 86
3.7 A Semi-Stochastic Emotional Model......Page 98
3.8 A Semi-Stochastic Combined Emotional Dialogue Model......Page 103
3.9 Extending the Semi-Stochastic Combined Emotional Dialogue Model......Page 108
3.10 Discussion......Page 112
4 Hybrid Approach to Speech–Emotion Recognition......Page 114
4.1 Signal Processing......Page 115
4.1.1 Preprocessing......Page 117
4.1.3 Mel-Frequency Cepstral Coefficients......Page 119
4.1.4 Prosodic and Acoustic Features......Page 120
4.2 Classifiers for Emotion Recognition......Page 127
4.2.1 Hidden Markov Models......Page 128
4.2.2 Artificial Neural Networks......Page 132
4.3 Existing Approaches to Emotion Recognition......Page 134
4.4 HMM-Based Speech Recognition......Page 138
4.5 HMM-Based Emotion Recognition......Page 142
4.6 Combined Speech and Emotion Recognition......Page 149
4.7 Emotion Recognition by Linguistic Analysis......Page 151
4.8 Discussion......Page 156
5.1 Emotion Recognizer Optimizations......Page 157
5.1.1 Plain Emotion Recognition......Page 158
5.1.2 Speech–Emotion Recognition......Page 161
5.2 Using Multiple (Speech–)Emotion Recognizers......Page 165
5.2.1 ROVER for Emotion Recognition......Page 172
5.2.2 ROVER for Speech–Emotion Recognition......Page 176
5.3 Implementation of Our Dialogue Manager......Page 179
5.4 Discussion......Page 191
6.1 Description of Dialogue System Evaluation Paradigms......Page 192
6.2 Speech Data Used for the Emotion Recognizer Evaluation......Page 195
6.3 Performance of Our Emotion Recognizer......Page 197
6.3.1 Plain Emotion Recognition......Page 203
6.3.2 Speech–Emotion Recognition......Page 207
6.3.3 Combining Multiple Speech–Emotion Recognizers......Page 216
6.3.4 Emotion Recognition by Linguistic Analysis......Page 220
6.4 Evaluation of Our Dialogue Manager......Page 222
6.5 Discussion......Page 228
7 Conclusion and Future Directions......Page 231
A Emotional Speech Databases......Page 240
B Used Abbreviations......Page 254
References......Page 256
Index......Page 276