1
|
Tilmatine M, Lüdtke J, Jacobs AM. Predicting subjective ratings of affect and comprehensibility with text features: a reader response study of narrative poetry. Front Psychol 2024; 15:1431764. [PMID: 39439760 PMCID: PMC11494826 DOI: 10.3389/fpsyg.2024.1431764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2024] [Accepted: 09/11/2024] [Indexed: 10/25/2024] Open
Abstract
Literary reading is an interactive process between a reader and a text that depends on a balance between cognitive effort and emotional rewards. By studying both the crucial features of the text and of the subjective reader reception, a better understanding of this interactive process can be reached. In the present study, subjects (N=31) read and rated a work of narrative fiction that was written in a poetic style, thereby offering the readers two pathways to cognitive rewards: Aesthetic appreciation and narrative immersion. Using purely text-based quantitative descriptors, we were able to independently and accurately predict the subjective ratings in the dimensions comprehensibility, valence, arousal, and liking across roughly 140 pages of naturalistic text. The specific text features that were most important in predicting each rating dimension are discussed in detail. In addition, the implications of the findings are discussed more generally in the context of existing models of literary processing and future research avenues for empirical literary studies.
Collapse
Affiliation(s)
- Mesian Tilmatine
- Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin, Berlin, Germany
- Centre for Language Studies, Department of Language and Communication, Faculty of Arts, Radboud University, Nijmegen, Netherlands
- Donders Centre for Cognition, Department of Artificial Intelligence, Faculty of Social Sciences, Radboud University, Nijmegen, Netherlands
| | - Jana Lüdtke
- Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin, Berlin, Germany
| | - Arthur M. Jacobs
- Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin, Berlin, Germany
- Center for Cognitive Neuroscience Berlin, Department of Education and Psychology, Free University of Berlin, Berlin, Germany
| |
Collapse
|
2
|
Ying L, Ruyang Y, Chuanbin N, Yeqing W, Qing L, Yufan Z, Fei G. ANCW: Affective norms for 4030 Chinese words. Behav Res Methods 2024; 56:4893-4908. [PMID: 37801213 DOI: 10.3758/s13428-023-02226-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/27/2023] [Indexed: 10/07/2023]
Abstract
Affective information contained in words is gaining increased attention among neurolinguists and psycholinguists around the world. This study established the Affective Norms for Chinese Words (ANCW) with valence, arousal, dominance, and concreteness ratings for 4030 words that were Chinese adaptations of the CET-4 (The National College English Test Band 4) official syllabus. Despite the existing Chinese affective norms such as the Chinese Affective Words System (CAWS), the ANCW provides much more and richer Chinese vocabulary. By using 7-point (ranging from 1 to 7) Likert scales in a paper-and-pencil procedure, we obtained ratings for all variables from 3717 Chinese undergraduates. The ANCW norms possessed good response reliability and were compatible with prior normative studies in Chinese. The pairwise correlation analysis revealed quadratic relations between valence and arousal, arousal and dominance, as well as valence and concreteness. Additionally, valence and dominance, as well as arousal and concreteness, presented a linear correlation, and concreteness and dominance were correlated. The ANCW provides reliable and standardized stimulus materials for further research involving emotional language processing.
Collapse
Affiliation(s)
- Lv Ying
- School of Foreign Languages and Cultures, Nanjing Normal University, No. 122# Ninghai Road, Nanjing, 210097, People's Republic of China
| | - Ye Ruyang
- School of Foreign Languages and Cultures, Nanjing Normal University, No. 122# Ninghai Road, Nanjing, 210097, People's Republic of China
| | - Ni Chuanbin
- School of Foreign Languages and Cultures, Nanjing Normal University, No. 122# Ninghai Road, Nanjing, 210097, People's Republic of China.
| | - Wang Yeqing
- School of Foreign Languages and Cultures, Nanjing Normal University, No. 122# Ninghai Road, Nanjing, 210097, People's Republic of China
| | - Liu Qing
- School of Foreign Languages and Cultures, Nanjing Normal University, No. 122# Ninghai Road, Nanjing, 210097, People's Republic of China
| | - Zhou Yufan
- School of Foreign Languages and Cultures, Nanjing Normal University, No. 122# Ninghai Road, Nanjing, 210097, People's Republic of China
| | - Gao Fei
- School of Foreign Languages and Cultures, Nanjing Normal University, No. 122# Ninghai Road, Nanjing, 210097, People's Republic of China
| |
Collapse
|
3
|
Kadoya Y, Fukuda S, Khan MSR. Could Having Access to Real-Time Data on Your Emotions Influence Subsequent Behavior? Evidence from a Randomized Controlled Trial of Japanese Office Workers. Behav Sci (Basel) 2024; 14:169. [PMID: 38540473 PMCID: PMC10968514 DOI: 10.3390/bs14030169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2023] [Revised: 12/15/2023] [Accepted: 02/20/2024] [Indexed: 11/11/2024] Open
Abstract
Improvements in mental health through real-time feedback on emotions have consequences for productivity and employee wellness. However, we find few extant studies on how real-time feedback on emotions can influence subsequent behavior modification in the Japanese workplace. We conducted a randomized controlled trial (RCT) with 30 employees of an insurance company in Japan and observed their emotions for 10 working days using a wearable biometric device. We compared the emotions of employees who had access to real-time emotional states (treatment group) with those of employees who did not (control group). The results of the panel regression analysis showed that access to real-time emotions was negatively associated with happy emotions and positively associated with angry and sad emotions. The results indicated that even after having access to the objective statuses of emotions, participants were unable to continue with happy emotions and reverse angry and sad emotions to other comfortable emotions. Our findings imply that feedback on real-time emotional states should be associated with appropriate training and motivation to utilize feedback for behavioral modification.
Collapse
Affiliation(s)
- Yoshihiko Kadoya
- School of Economics, Hiroshima University, 1-2-1 Kagamiyama, Higashihiroshima 7398525, Japan; (S.F.); (M.S.R.K.)
| | | | | |
Collapse
|
4
|
Zsidó AN. The effect of emotional arousal on visual attentional performance: a systematic review. PSYCHOLOGICAL RESEARCH 2024; 88:1-24. [PMID: 37417982 PMCID: PMC10805986 DOI: 10.1007/s00426-023-01852-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Accepted: 06/25/2023] [Indexed: 07/08/2023]
Abstract
Although the arousal elicited by emotional stimuli, similarly to valence, is an integrative part of emotion theories, previous studies and reviews mostly focused on the valence of a stimulus and rarely investigated the role of arousal. Here, I systematically searched for articles that used visual attentional paradigms, manipulated emotional arousal by auditory or visual, task-relevant or task-irrelevant stimuli, measured behavioral responses, ocular behavior, or neural correlates. I found that task-relevant arousing stimuli draw and hold attention regardless of the modality. In contrast, task-irrelevant arousing stimuli impaired task performance. However, when the emotional content precedes the task or it is presented for a longer duration, arousal increased performance. Future directions on how research could address the remaining questions are discussed.
Collapse
Affiliation(s)
- Andras N Zsidó
- Institute of Psychology, University of Pécs, 6 Ifjusag Str., Pécs, 7624, Hungary.
| |
Collapse
|
5
|
Troscianko ET, Holman E, Carney J. Quantitative methods for group bibliotherapy research: a pilot study. Wellcome Open Res 2024; 7:79. [PMID: 38435449 PMCID: PMC10905136 DOI: 10.12688/wellcomeopenres.17469.1] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/20/2023] [Indexed: 03/05/2024] Open
Abstract
Background Bibliotherapy is under-theorized and under-tested: Its purposes and implementations vary widely, and the idea that 'reading is good for you' is often more assumed than demonstrated. One obstacle to developing robust empirical and theoretical foundations for bibliotherapy is the absence of analytical methods capable of providing sensitive yet replicable insights into complex textual material. This pilot study offers a proof-of-concept for new quantitative methods including VAD (valence-arousal-dominance) modelling of emotional variance and doc2vec modelling of linguistic similarity. Methods VAD and doc2vec modelling were used on conjunction with qualitative coding to analyse transcripts of reading-group discussions plus the literary texts being discussed, from two reading groups each meeting weekly for six weeks (including 9 participants [5 researchers (3 authors, 2 collaborators), 4 others] in Group 1, and 8 participants [2 authors, 6 others] in Group 2). Results In-text-discussion similarity was inversely correlated with emotional volatility in the group discussions (arousal: r = -0.25; p = ns; dominance: r = 0.21; p = ns; valence: r = -0.28; p = ns). Enjoyment or otherwise of the texts was less significant than other factors in shaping the significance and potential benefits of participation. (Texts with unpleasant or disturbing content that strongly shaped subsequent discussions of these texts were still able to sponsor 'healthy' discussions of this content.). Conclusions Our methods and findings offer for the field of bibliotherapy research both new possibilities for hypotheses to test, and viable ways of testing them. In particular, the use of natural language processing methods and word norm data offer valuable complements to intuitive human judgement and self-report when assessing the impact of literary materials. We also share observations on facilitation protocols, interpretative practices, and how our group reading model differs from other trials of group reading for wellbeing.
Collapse
Affiliation(s)
- Emily T. Troscianko
- The Oxford Research Centre for the Humanities, University of Oxford, Oxford, UK
| | | | | |
Collapse
|
6
|
Girard JM, Tie Y, Liebenthal E. DynAMoS: The Dynamic Affective Movie Clip Database for Subjectivity Analysis. INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION AND WORKSHOPS : [PROCEEDINGS]. ACII (CONFERENCE) 2023; 2023:10.1109/acii59096.2023.10388135. [PMID: 38282890 PMCID: PMC10812085 DOI: 10.1109/acii59096.2023.10388135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/30/2024]
Abstract
In this paper, we describe the design, collection, and validation of a new video database that includes holistic and dynamic emotion ratings from 83 participants watching 22 affective movie clips. In contrast to previous work in Affective Computing, which pursued a single "ground truth" label for the affective content of each moment of each video (e.g., by averaging the ratings of 2 to 7 trained participants), we embrace the subjectivity inherent to emotional experiences and provide the full distribution of all participants' ratings (with an average of 76.7 raters per video). We argue that this choice represents a paradigm shift with the potential to unlock new research directions, generate new hypotheses, and inspire novel methods in the Affective Computing community. We also describe several interdisciplinary use cases for the database: to provide dynamic norms for emotion elicitation studies (e.g., in psychology, medicine, and neuroscience), to train and test affective content analysis algorithms (e.g., for dynamic emotion recognition, video summarization, and movie recommendation), and to study subjectivity in emotional reactions (e.g., to identify moments of emotional ambiguity or ambivalence within movies, identify predictors of subjectivity, and develop personalized affective content analysis algorithms). The database is made freely available to researchers for noncommercial use at https://dynamos.mgb.org.
Collapse
Affiliation(s)
- Jeffrey M Girard
- Department of Psychology, University of Kansas, Lawrence, KS, USA
| | - Yanmei Tie
- Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | | |
Collapse
|
7
|
Klein RJ, Jacobson NC, Robinson MD. A psychological flexibility perspective on well-being: Emotional reactivity, adaptive choices, and daily experiences. Emotion 2023; 23:911-924. [PMID: 36048033 PMCID: PMC10035040 DOI: 10.1037/emo0001159] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
According to psychological flexibility theory, fully experiencing one's emotions, even when they involve negative reactions, can enhance psychological well-being. In pursuit of this possibility, procedures capable of disentangling reaction intensities from reaction durations, in response to affective images, were developed and variations of this paradigm were applied in understanding variations in happiness and adaptive behavior. Consistent with psychological flexibility theory, three studies showed that more intense emotional reactions, irrespective of valence, were associated with higher levels of well-being. Two additional studies showed that happy individuals, relative to less happy individuals, exhibited more functional approach/avoidance behavior in behavior-focused tasks. Together, the results are consistent with the idea that adaptive emotion generation systems are those that flexibly adapt emotion output to concurrent emotion-related stimulation. The program of research adds to our understanding of the relationship between emotion reactivity and well-being while highlighting specific processes through which emotion and well-being interact. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Collapse
Affiliation(s)
- Robert J. Klein
- Center for Technology and Behavioral Health, Geisel School of Medicine, Dartmouth College
| | - Nicholas C. Jacobson
- Center for Technology and Behavioral Health, Geisel School of Medicine, Dartmouth College
| | | |
Collapse
|
8
|
BOYACİOGLU İ, KONUKOĞLU K, ERGİYEN T. Effect of Emotional Content on Memory Characteristics: Emotional Valence, Emotional Intensity, and Individual Emotions. PSIKIYATRIDE GUNCEL YAKLASIMLAR - CURRENT APPROACHES IN PSYCHIATRY 2022. [DOI: 10.18863/pgy.1068175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
The aim of the present study is to examine the relationships between the emotional valence and emotional intensity of autobiographical memories and the phenomenological characteristics of memories in the context of individual emotions and memory types. Seven hundred and sixty-four students (514 female, 250 male) from Dokuz Eylul University participated in the study. Participants were asked to recall an childhood memory, a self-defining memory, or a romantic relationship memory. After thinking about the memory they remember, they were requested to fill out the Autobiographical Memory Characteristics Questionnaire and a scale for intensity of individual emotions. Regression analyses showed that emotional intensity of the memories predicted the sensory details, rehearsal, and preoccupation with emotions. In moderated-mediation analyses, mediating effects for emotional intensity were detected between individual emotions and memory characteristics, except for the negative self-esteem emotions. Among these analyses, a moderating effect of memory types was detected only for the relationships between hostile emotions and anxiety-related emotions and the memory characteristics through the mediation of emotional intensity. While the intensity of singular emotions showed stronger relationship with emotional valence, the main variable that predicted memory characteristics overall was the emotional intensity.
Collapse
|
9
|
Radhakrishnan U, Chinello F, Koumaditis K. Investigating the effectiveness of immersive VR skill training and its link to physiological arousal. VIRTUAL REALITY 2022; 27:1091-1115. [PMID: 36405878 PMCID: PMC9663202 DOI: 10.1007/s10055-022-00699-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Accepted: 09/13/2022] [Indexed: 06/05/2023]
Abstract
This paper details the motivations, design, and analysis of a study using a fine motor skill training task in both VR and physical conditions. The objective of this between-subjects study was to (a) investigate the effectiveness of immersive virtual reality for training participants in the 'buzz-wire' fine motor skill task compared to physical training and (b) investigate the link between participants' arousal with their improvements in task performance. Physiological arousal levels in the form of electro-dermal activity (EDA) and ECG (Electrocardiogram) data were collected from 87 participants, randomly distributed across the two conditions. Results indicated that VR training is as good as, or even slightly better than, training in physical training in improving task performance. Moreover, the participants in the VR condition reported an increase in self-efficacy and immersion, while marginally significant differences were observed in the presence and the temporal demand (retrieved from NASA-TLX measurements). Participants in the VR condition showed on average less arousal than those in the physical condition. Though correlation analyses between performance metrics and arousal levels did not depict any statistically significant results, a closer examination of EDA values revealed that participants with lower arousal levels during training, across conditions, demonstrated better improvements in performance than those with higher arousal. These findings demonstrate the effectiveness of VR in training and the potential of using arousal and training performance data for designing adaptive VR training systems. This paper also discusses implications for researchers who consider using biosensors and VR for motor skill experiments. Supplementary Information The online version contains supplementary material available at 10.1007/s10055-022-00699-3.
Collapse
Affiliation(s)
- Unnikrishnan Radhakrishnan
- Department of Business Development and Technology, Aarhus University, Birk Centerpark 15, 7400 Herning, Denmark
| | - Francesco Chinello
- Department of Business Development and Technology, Aarhus University, Birk Centerpark 15, 7400 Herning, Denmark
| | - Konstantinos Koumaditis
- Department of Business Development and Technology, Aarhus University, Birk Centerpark 15, 7400 Herning, Denmark
| |
Collapse
|
10
|
Kaklauskas A, Abraham A, Ubarte I, Kliukas R, Luksaite V, Binkyte-Veliene A, Vetloviene I, Kaklauskiene L. A Review of AI Cloud and Edge Sensors, Methods, and Applications for the Recognition of Emotional, Affective and Physiological States. SENSORS (BASEL, SWITZERLAND) 2022; 22:7824. [PMID: 36298176 PMCID: PMC9611164 DOI: 10.3390/s22207824] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Revised: 09/28/2022] [Accepted: 10/12/2022] [Indexed: 06/16/2023]
Abstract
Affective, emotional, and physiological states (AFFECT) detection and recognition by capturing human signals is a fast-growing area, which has been applied across numerous domains. The research aim is to review publications on how techniques that use brain and biometric sensors can be used for AFFECT recognition, consolidate the findings, provide a rationale for the current methods, compare the effectiveness of existing methods, and quantify how likely they are to address the issues/challenges in the field. In efforts to achieve the key goals of Society 5.0, Industry 5.0, and human-centered design better, the recognition of emotional, affective, and physiological states is progressively becoming an important matter and offers tremendous growth of knowledge and progress in these and other related fields. In this research, a review of AFFECT recognition brain and biometric sensors, methods, and applications was performed, based on Plutchik's wheel of emotions. Due to the immense variety of existing sensors and sensing systems, this study aimed to provide an analysis of the available sensors that can be used to define human AFFECT, and to classify them based on the type of sensing area and their efficiency in real implementations. Based on statistical and multiple criteria analysis across 169 nations, our outcomes introduce a connection between a nation's success, its number of Web of Science articles published, and its frequency of citation on AFFECT recognition. The principal conclusions present how this research contributes to the big picture in the field under analysis and explore forthcoming study trends.
Collapse
Affiliation(s)
- Arturas Kaklauskas
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Ajith Abraham
- Machine Intelligence Research Labs, Scientific Network for Innovation and Research Excellence, Auburn, WA 98071, USA
| | - Ieva Ubarte
- Institute of Sustainable Construction, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Romualdas Kliukas
- Department of Applied Mechanics, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Vaida Luksaite
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Arune Binkyte-Veliene
- Institute of Sustainable Construction, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Ingrida Vetloviene
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| | - Loreta Kaklauskiene
- Department of Construction Management and Real Estate, Vilnius Gediminas Technical University, Sauletekio Ave. 11, LT-10223 Vilnius, Lithuania
| |
Collapse
|
11
|
Cognitive motivations and foundations for building intelligent decision-making systems. Artif Intell Rev 2022. [DOI: 10.1007/s10462-022-10255-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
AbstractConcepts based on psychology fit well with current research trends related to robotics and artificial intelligence. Biology-inspired cognitive architectures are extremely useful in building agents and robots, and this is one of the most important challenges of modern science. Therefore, the widely viewed and far-reaching goal of systems research and engineering is virtual agents and autonomous robots that mimic human behavior in solving known and unknown problems. The article proposes, at a high level of generality, an operational cybernetic model of the human mind, developed with the use of carefully selected ideas taken from psychological knowledge. In particular, the work combines extensive knowledge drawn from both the theory of developmental cognitive psychology and the theory of motivation. The proposed mathematically developed operating blocks create a coherent and functional decision-making system containing all the elements necessary in autonomous robotics. The ISD system is under development. There is still a long way to go to full validation. However, as shown in several articles, the basic subsystems of the ISD system, i.e. motivational and emotional, have already been positively verified in operation. The overall purpose of this article is to show a blueprint of the overall concept of the entire ISD.
Collapse
|
12
|
Della Longa L, Sacchetti S, Farroni T, McGlone F. Does Nice or Nasty Matter? The Intensity of Touch Modulates the Rubber Hand Illusion. Front Psychol 2022; 13:901413. [PMID: 35769756 PMCID: PMC9234571 DOI: 10.3389/fpsyg.2022.901413] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Accepted: 05/23/2022] [Indexed: 11/18/2022] Open
Abstract
Our sense of body ownership results from the ongoing integration of perceptual information coming from the different senses (i.e., multisensory integration). The Rubber Hand Illusion (RHI) has been extensively studied to investigate the malleability of body ownership through contrasting multisensory information. Indeed, during the RHI, stroking a visible rubber hand synchronously to participants’ hand hidden from sight generates the illusion of ownership of the rubber hand (embodiment) and the mis-location of participants’ hand as closer to the rubber hand (proprioceptive drift). It is well known that the RHI is optimally evoked by a pleasant stroking (affective) touch, but what of an unpleasant (painful) stroking touch – does hedonic valence matter? To this aim, participants repeated the RHI while receiving different types of touch: pleasant, painful, and neutral. Results showed, for the first time, that the subjective intensity of the tactile stimulation experienced across the different conditions modulates the strength of the proprioceptive drift. Notably, participants reported a stronger RHI (mis-placed body ownership) from stimulation rated as more intense and involving an interoceptive activation (pain and pleasantness vs. neutral). We propose that interoceptive information, regardless of the valence of the stimuli (positive or negative), are perceived as more intense and enhance, through the activation of the limbic system, multisensory integration. In the context of the RHI, this translates to a stronger illusion in terms of proprioceptive drift.
Collapse
Affiliation(s)
- Letizia Della Longa
- Department of Developmental Psychology and Socialisation, University of Padova, Padua, Italy
- *Correspondence: Letizia Della Longa,
| | - Sofia Sacchetti
- School of Psychology, Liverpool John Moores University, Liverpool, United Kingdom
| | - Teresa Farroni
- Department of Developmental Psychology and Socialisation, University of Padova, Padua, Italy
| | - Francis McGlone
- School of Psychology, Liverpool John Moores University, Liverpool, United Kingdom
| |
Collapse
|
13
|
Blain B, Marks J, Czech P, Sharot T. Observing others give & take: A computational account of bystanders' feelings and actions. PLoS Comput Biol 2022; 18:e1010010. [PMID: 35500029 PMCID: PMC9098039 DOI: 10.1371/journal.pcbi.1010010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2020] [Revised: 05/12/2022] [Accepted: 03/10/2022] [Indexed: 11/25/2022] Open
Abstract
Social interactions influence people's feelings and behavior. Here, we propose that a person's well-being is influenced not only by interactions they experience themselves, but also by those they observe. In particular, we test and quantify the influence of observed selfishness and observed inequality on a bystanders' feelings and non-costly punishment decisions. We developed computational models that relate others' (un)selfish acts to observers' emotional reactions and punishment decisions. These characterize the rules by which others' interactions are transformed into bystanders' reactions, and successfully predict those reactions in out-of-sample participants. The models highlight the impact of two social values-'selfishness aversion' and 'inequality aversion'. As for the latter we find that even small violations from perfect equality have a disproportionately large impact on feelings and punishment. In this age of internet and social media we constantly observe others' online interactions, in addition to in-person interactions. Quantifying the consequences of such observations is important for predicting their impact on society.
Collapse
Affiliation(s)
- Bastien Blain
- Affective Brain Lab, Experimental Psychology, University College London, London, United Kingdom
| | - Joseph Marks
- Affective Brain Lab, Experimental Psychology, University College London, London, United Kingdom
| | - Philipp Czech
- Affective Brain Lab, Experimental Psychology, University College London, London, United Kingdom
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Tali Sharot
- Affective Brain Lab, Experimental Psychology, University College London, London, United Kingdom
- The Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Boston, United State of America
| |
Collapse
|
14
|
Emotion Classification from Speech and Text in Videos Using a Multimodal Approach. MULTIMODAL TECHNOLOGIES AND INTERACTION 2022. [DOI: 10.3390/mti6040028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Emotion classification is a research area in which there has been very intensive literature production concerning natural language processing, multimedia data, semantic knowledge discovery, social network mining, and text and multimedia data mining. This paper addresses the issue of emotion classification and proposes a method for classifying the emotions expressed in multimodal data extracted from videos. The proposed method models multimodal data as a sequence of features extracted from facial expressions, speech, gestures, and text, using a linguistic approach. Each sequence of multimodal data is correctly associated with the emotion by a method that models each emotion using a hidden Markov model. The trained model is evaluated on samples of multimodal sentences associated with seven basic emotions. The experimental results demonstrate a good classification rate for emotions.
Collapse
|
15
|
Filippini C, Di Crosta A, Palumbo R, Perpetuini D, Cardone D, Ceccato I, Di Domenico A, Merla A. Automated Affective Computing Based on Bio-Signals Analysis and Deep Learning Approach. SENSORS 2022; 22:s22051789. [PMID: 35270936 PMCID: PMC8914721 DOI: 10.3390/s22051789] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Revised: 02/21/2022] [Accepted: 02/22/2022] [Indexed: 12/18/2022]
Abstract
Extensive possibilities of applications have rendered emotion recognition ineluctable and challenging in the fields of computer science as well as in human-machine interaction and affective computing. Fields that, in turn, are increasingly requiring real-time applications or interactions in everyday life scenarios. However, while extremely desirable, an accurate and automated emotion classification approach remains a challenging issue. To this end, this study presents an automated emotion recognition model based on easily accessible physiological signals and deep learning (DL) approaches. As a DL algorithm, a Feedforward Neural Network was employed in this study. The network outcome was further compared with canonical machine learning algorithms such as random forest (RF). The developed DL model relied on the combined use of wearables and contactless technologies, such as thermal infrared imaging. Such a model is able to classify the emotional state into four classes, derived from the linear combination of valence and arousal (referring to the circumplex model of affect’s four-quadrant structure) with an overall accuracy of 70% outperforming the 66% accuracy reached by the RF model. Considering the ecological and agile nature of the technique used the proposed model could lead to innovative applications in the affective computing field.
Collapse
Affiliation(s)
- Chiara Filippini
- Department of Neurosciences, Imaging and Clinical Sciences, University G. D’Annunzio of Chieti-Pescara, 9, 66100 Chieti, Italy; (C.F.); (D.P.); (D.C.); (I.C.)
| | - Adolfo Di Crosta
- Department of Psychological, Health and Territorial Sciences, University G. D’Annunzio of Chieti-Pescara, 9, 66100 Chieti, Italy; (A.D.C.); (R.P.); (A.D.D.)
| | - Rocco Palumbo
- Department of Psychological, Health and Territorial Sciences, University G. D’Annunzio of Chieti-Pescara, 9, 66100 Chieti, Italy; (A.D.C.); (R.P.); (A.D.D.)
| | - David Perpetuini
- Department of Neurosciences, Imaging and Clinical Sciences, University G. D’Annunzio of Chieti-Pescara, 9, 66100 Chieti, Italy; (C.F.); (D.P.); (D.C.); (I.C.)
| | - Daniela Cardone
- Department of Neurosciences, Imaging and Clinical Sciences, University G. D’Annunzio of Chieti-Pescara, 9, 66100 Chieti, Italy; (C.F.); (D.P.); (D.C.); (I.C.)
| | - Irene Ceccato
- Department of Neurosciences, Imaging and Clinical Sciences, University G. D’Annunzio of Chieti-Pescara, 9, 66100 Chieti, Italy; (C.F.); (D.P.); (D.C.); (I.C.)
| | - Alberto Di Domenico
- Department of Psychological, Health and Territorial Sciences, University G. D’Annunzio of Chieti-Pescara, 9, 66100 Chieti, Italy; (A.D.C.); (R.P.); (A.D.D.)
| | - Arcangelo Merla
- Department of Neurosciences, Imaging and Clinical Sciences, University G. D’Annunzio of Chieti-Pescara, 9, 66100 Chieti, Italy; (C.F.); (D.P.); (D.C.); (I.C.)
- Correspondence: ; Tel.: +39-0871-3556-954
| |
Collapse
|
16
|
Guerdelli H, Ferrari C, Barhoumi W, Ghazouani H, Berretti S. Macro- and Micro-Expressions Facial Datasets: A Survey. SENSORS 2022; 22:s22041524. [PMID: 35214430 PMCID: PMC8879817 DOI: 10.3390/s22041524] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 02/10/2022] [Accepted: 02/11/2022] [Indexed: 11/16/2022]
Abstract
Automatic facial expression recognition is essential for many potential applications. Thus, having a clear overview on existing datasets that have been investigated within the framework of face expression recognition is of paramount importance in designing and evaluating effective solutions, notably for neural networks-based training. In this survey, we provide a review of more than eighty facial expression datasets, while taking into account both macro- and micro-expressions. The proposed study is mostly focused on spontaneous and in-the-wild datasets, given the common trend in the research is that of considering contexts where expressions are shown in a spontaneous way and in a real context. We have also provided instances of potential applications of the investigated datasets, while putting into evidence their pros and cons. The proposed survey can help researchers to have a better understanding of the characteristics of the existing datasets, thus facilitating the choice of the data that best suits the particular context of their application.
Collapse
Affiliation(s)
- Hajer Guerdelli
- Research Team on Intelligent Systems in Imaging and Artificial Vision (SIIVA), LR16ES06 Laboratoire de Recherche en Informatique, Modélisation et Traitement de’Information et dea Connaissance (LIMTIC), Institut Supérieur d’Informatique d’El Manar, Université de Tunis El Manar, Tunis 1068, Tunisia; (H.G.); (W.B.); (H.G.)
- Media Integration and Communication Center, University of Florence, 50121 Firenze, Italy
| | - Claudio Ferrari
- Department of Engineering and Architecture, University of Parma, 43121 Parma, Italy;
| | - Walid Barhoumi
- Research Team on Intelligent Systems in Imaging and Artificial Vision (SIIVA), LR16ES06 Laboratoire de Recherche en Informatique, Modélisation et Traitement de’Information et dea Connaissance (LIMTIC), Institut Supérieur d’Informatique d’El Manar, Université de Tunis El Manar, Tunis 1068, Tunisia; (H.G.); (W.B.); (H.G.)
- Ecole Nationale d’Ingénieurs de Carthage, Université de Carthage, Carthage 1054, Tunisia
| | - Haythem Ghazouani
- Research Team on Intelligent Systems in Imaging and Artificial Vision (SIIVA), LR16ES06 Laboratoire de Recherche en Informatique, Modélisation et Traitement de’Information et dea Connaissance (LIMTIC), Institut Supérieur d’Informatique d’El Manar, Université de Tunis El Manar, Tunis 1068, Tunisia; (H.G.); (W.B.); (H.G.)
- Ecole Nationale d’Ingénieurs de Carthage, Université de Carthage, Carthage 1054, Tunisia
| | - Stefano Berretti
- Media Integration and Communication Center, University of Florence, 50121 Firenze, Italy
- Correspondence: ; Tel.: +39-216-96202969
| |
Collapse
|
17
|
Hou TY, Cai WP. What emotion dimensions can affect working memory performance in healthy adults? A review. World J Clin Cases 2022; 10:401-411. [PMID: 35097065 PMCID: PMC8771390 DOI: 10.12998/wjcc.v10.i2.401] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 08/28/2021] [Accepted: 11/30/2021] [Indexed: 02/06/2023] Open
Abstract
Due to the critical roles of emotion and working memory in our daily activities, a great deal of attention has been given to how emotion influences working memory performance. Although the association between emotion and working memory is relatively well established, whether mood enhances or impairs working memory performance remains controversial. The present review provides a relatively representative overview of the research on the effect of different dimensions of emotion on working memory among healthy adults spanning a 30-year period. The findings show that the valence, arousal and motivational dimensions of emotion could all exert an impact on working memory performance. The impact of emotion on working memory might be modulated by task relevance, emotion type, working memory paradigms and individual differences. The vast majority of the studies regarding the effect of emotion on working memory performance focused on the impact of negatively valenced affect and yielded highly contradictory findings. The impacts of arousal and motivation on working memory have been less explored, and inconsistent findings have also been reported. Possible explanations are discussed. Considerable research on the effect of certain dimensions of emotion on working memory has suffered from a lack of control of other emotional dimensions, and different aspects of working memory have been investigated by various paradigms. Directions for further studies should include the exploration of specific dimensions of emotion on different aspects of working memory, with the other dimensions being well controlled.
Collapse
Affiliation(s)
- Tian-Ya Hou
- Faculty of Psychology, The Second Military Medical University, Shanghai 200433, China
| | - Wen-Peng Cai
- Faculty of Psychology, The Second Military Medical University, Shanghai 200433, China
| |
Collapse
|
18
|
De Filippi E, Wolter M, Melo BRP, Tierra-Criollo CJ, Bortolini T, Deco G, Moll J. Classification of Complex Emotions Using EEG and Virtual Environment: Proof of Concept and Therapeutic Implication. Front Hum Neurosci 2021; 15:711279. [PMID: 34512297 PMCID: PMC8427812 DOI: 10.3389/fnhum.2021.711279] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Accepted: 07/29/2021] [Indexed: 11/29/2022] Open
Abstract
During the last decades, neurofeedback training for emotional self-regulation has received significant attention from scientific and clinical communities. Most studies have investigated emotions using functional magnetic resonance imaging (fMRI), including the real-time application in neurofeedback training. However, the electroencephalogram (EEG) is a more suitable tool for therapeutic application. Our study aims at establishing a method to classify discrete complex emotions (e.g., tenderness and anguish) elicited through a near-immersive scenario that can be later used for EEG-neurofeedback. EEG-based affective computing studies have mainly focused on emotion classification based on dimensions, commonly using passive elicitation through single-modality stimuli. Here, we integrated both passive and active elicitation methods. We recorded electrophysiological data during emotion-evoking trials, combining emotional self-induction with a multimodal virtual environment. We extracted correlational and time-frequency features, including frontal-alpha asymmetry (FAA), using Complex Morlet Wavelet convolution. Thinking about future real-time applications, we performed within-subject classification using 1-s windows as samples and we applied trial-specific cross-validation. We opted for a traditional machine-learning classifier with low computational complexity and sufficient validation in online settings, the Support Vector Machine. Results of individual-based cross-validation using the whole feature sets showed considerable between-subject variability. The individual accuracies ranged from 59.2 to 92.9% using time-frequency/FAA and 62.4 to 92.4% using correlational features. We found that features of the temporal, occipital, and left-frontal channels were the most discriminative between the two emotions. Our results show that the suggested pipeline is suitable for individual-based classification of discrete emotions, paving the way for future personalized EEG-neurofeedback training.
Collapse
Affiliation(s)
- Eleonora De Filippi
- Computational Neuroscience Group, Center for Brain and Cognition, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain
| | - Mara Wolter
- Cognitive Neuroscience and Neuroinformatics Unit, D'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil
| | - Bruno R. P. Melo
- Cognitive Neuroscience and Neuroinformatics Unit, D'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil
- Biomedical Engineering Program, Instituto Alberto Luiz Coimbra de Pós-Graduação e Pesquisa de Engenharia, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Carlos J. Tierra-Criollo
- Biomedical Engineering Program, Instituto Alberto Luiz Coimbra de Pós-Graduação e Pesquisa de Engenharia, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Tiago Bortolini
- Cognitive Neuroscience and Neuroinformatics Unit, D'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil
| | - Gustavo Deco
- Computational Neuroscience Group, Center for Brain and Cognition, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain
- Institució Catalana de la Recerca i Estudis Avançats, Barcelona, Spain
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Turner Institute for Brain and Mental Health, Monash University, Melbourne, VIC, Australia
| | - Jorge Moll
- Cognitive Neuroscience and Neuroinformatics Unit, D'Or Institute for Research and Education (IDOR), Rio de Janeiro, Brazil
- Scients Institute, Palo Alto, CA, United States
| |
Collapse
|
19
|
Abstract
In the last 14 months, COVID-19 made face-to-face meetings impossible and this has led to rapid growth in videoconferencing. As highly social creatures, humans strive for direct interpersonal interaction, which means that in most of these video meetings the webcam is switched on and people are “looking each other in the eyes”. However, it is far from clear what the psychological consequences of this shift to virtual face-to-face communication are and if there are methods to alleviate “videoconferencing fatigue”. We have studied the influence of emotions of meeting participants on the perceived outcome of video meetings. Our experimental setting consisted of 35 participants collaborating in eight teams over Zoom in a one semester course on Collaborative Innovation Networks in bi-weekly video meetings, where each team presented its progress. Emotion was tracked through Zoom face video snapshots using facial emotion recognition that recognized six emotions (happy, sad, fear, anger, neutral, and surprise). Our dependent variable was a score given after each presentation by all participants except the presenter. We found that the happier the speaker is, the happier and less neutral the audience is. More importantly, we found that the presentations that triggered wide swings in “fear” and “joy” among the participants are correlated with a higher rating. Our findings provide valuable input for online video presenters on how to conduct better and less tiring meetings; this will lead to a decrease in “videoconferencing fatigue”.
Collapse
|
20
|
Azevedo IL, Keniston L, Rocha HR, Imbiriba LA, Saunier G, Nogueira-Campos AA. Emotional categorization of objects: A novel clustering approach and the effect of depression. Behav Brain Res 2021; 406:113223. [PMID: 33677014 DOI: 10.1016/j.bbr.2021.113223] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2020] [Revised: 02/16/2021] [Accepted: 02/26/2021] [Indexed: 10/22/2022]
Abstract
Most everyday actions engender interactions with meaningful emotionally-laden stimuli. This study aimed to select pictures of objects as emotional stimulus of affordance to be grasped. The participant's depression trait was also assessed to examine its effect on the judgment of these pictures, and time spent in the classification was computed. Sixty-three participants joined this study. Self-Assessment-Manikin scale was used to classify pictures of the objects, and Beck Depression Inventory was applied to distribute the sample according depression trait. Cluster analysis was used in the classification of 123 objects based on valence and arousal values. Cluster results returned 102 classified pictures in three categories: pleasant (21), neutral (48) and unpleasant (33). Where cluster analysis did not agree, the picture was excluded and not used any further (21). Pleasant pictures presented the highest valence values and unpleasant pictures the lowest, and both categories returned the highest arousal level. In the middle of the valence range, the neutral category evoked the lowest arousal levels. Participants were slower to classify unpleasant pictures in valence sub-scale and faster to classify neutral pictures in arousal one. There was no effect of depression in the response time needed to score the pictures. Thus, agreement of high-performance soft clustering algorithms emerged as a good tool to classify pictures representing objects based on valence and arousal dimensions. Depression trait does not significantly affect the accuracy or time-order of emotional classification. Finally, we presented a set of emotional stimuli that can be employed to examine distinct aspects of emotion over physiology and behavior.
Collapse
Affiliation(s)
- Ivo Lopes Azevedo
- Cognitive Neurophysiology Laboratory (LabNeuro), Department of Physiology, Institute of Biological Sciences, Federal University of Juiz de Fora, Minas Gerais, Brazil
| | - Les Keniston
- Department of Physical Therapy, University of Maryland Eastern Shore, MD, United States
| | - Helena Ribeiro Rocha
- Cognitive Neurophysiology Laboratory (LabNeuro), Department of Physiology, Institute of Biological Sciences, Federal University of Juiz de Fora, Minas Gerais, Brazil
| | - Luiz Aureliano Imbiriba
- Center of Study of Human Movement (NEMoH), Department of Bioscience, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Ghislain Saunier
- Motor Cognition Laboratory, Department of Anatomy, Federal University of Pará, Pará, Brazil
| | - Anaelli A Nogueira-Campos
- Cognitive Neurophysiology Laboratory (LabNeuro), Department of Physiology, Institute of Biological Sciences, Federal University of Juiz de Fora, Minas Gerais, Brazil.
| |
Collapse
|
21
|
Callejas-Cuervo M, Martínez-Tejada LA, Alarcón-Aldana AC. Emotion recognition from physiological signals and video games to detect personality traits. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2021. [DOI: 10.3233/jifs-189197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
This paper presents a system that allows for the identification of two values: arousal and valence, which represent the degree of stimulation in a subject, using Russell’s model of affect as a reference. To identify emotions, a step-by-step structure is used, which, based on statistical data from physiological signal metrics, generates the representative arousal value (direct correlation); from the PANAS questionnaire, the system generates the valence value (inverse correlation), as a first approximation to the techniques of emotion recognition without the use of artificial intelligence. The system gathers information concerning arousal activity from a subject using the following metrics: beats per minute (BPM), heart rate variability (HRV), the number of galvanic skin response (GSR) peaks in the skin conductance response (SCR) and forearm contraction time, using three physiological signals (Electrocardiogram - ECG, Galvanic Skin Response - GSR, Electromyography - EMG).
Collapse
Affiliation(s)
- Mauro Callejas-Cuervo
- Faculty of Engineering, School of Computer Science, Universidad Pedagógica y Tecnológica de Colombia, Avenida Central del Norte 39 – 115, Colombia
| | | | - Andrea Catherine Alarcón-Aldana
- Faculty of Engineering, School of Computer Science, Universidad Pedagógica y Tecnológica de Colombia, Avenida Central del Norte 39 – 115, Colombia
| |
Collapse
|
22
|
Teismann H, Kissler J, Berger K. Investigating the roles of age, sex, depression, and anxiety for valence and arousal ratings of words: a population-based study. BMC Psychol 2020; 8:118. [PMID: 33160414 PMCID: PMC7648958 DOI: 10.1186/s40359-020-00485-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2020] [Accepted: 10/28/2020] [Indexed: 01/04/2023] Open
Abstract
BACKGROUND The perception of the affective quality of stimuli with regard to valence and arousal has mostly been studied in laboratory experiments. Population-based research may complement such studies by accessing larger, older, better balanced, and more heterogeneous samples. Several characteristics, among them age, sex, depression, or anxiety, were found to be associated with affective quality perception. Here, we intended to transfer valence and arousal rating methods from experimental to population-based research. Our aim was to assess the feasibility of obtaining and determining the structure of valence and arousal ratings in the setting of the large observational BiDirect Study. Moreover, we explored the roles of age, sex, depression, and anxiety for valence and arousal ratings of words. METHODS 704 participants provided valence and arousal ratings for 12 written nouns pre-categorized as unpleasant, neutral, or pleasant. Predictors of valence and arousal ratings (i.e. age, sex, depression, and anxiety) were analyzed for six outcomes that emerge by combining two affective dimensions with three words categories. Data were modeled with multiple linear regression. Relative predictor importance was quantified by model-explained variance decomposition. RESULTS Overall, average population-based ratings replicated those found in laboratory settings. The model did not reach statistical significance in the valence dimension. In the arousal dimension, the model explained 5.4% (unpleasant), 4.6% (neutral), and 3.5% (pleasant) of the variance. (Trend) effects of sex on arousal ratings were found in all word categories (unpleasant: increased arousal in women; neutral, pleasant: decreased arousal in women). Effects of age and anxiety (increased arousal) were restricted to the neutral words. CONCLUSIONS We report results of valence and arousal ratings of words in the setting of a large, observational, population-based study. Method transfer yielded acceptable data quality. The analyses demonstrated small effects of the selected predictors in the arousal dimension.
Collapse
Affiliation(s)
- Henning Teismann
- Institute of Epidemiology and Social Medicine, University of Münster, Albert-Schweitzer-Campus 1 (Building D3), 48149, Münster, Germany.
| | - Johanna Kissler
- Department of Psychology, University of Bielefeld, Bielefeld, Germany.,Center of Excellence Cognitive Interaction Technology (CITEC), University of Bielefeld, Bielefeld, Germany
| | - Klaus Berger
- Institute of Epidemiology and Social Medicine, University of Münster, Albert-Schweitzer-Campus 1 (Building D3), 48149, Münster, Germany
| |
Collapse
|
23
|
Lim JZ, Mountstephens J, Teo J. Emotion Recognition Using Eye-Tracking: Taxonomy, Review and Current Challenges. SENSORS (BASEL, SWITZERLAND) 2020; 20:E2384. [PMID: 32331327 PMCID: PMC7219342 DOI: 10.3390/s20082384] [Citation(s) in RCA: 52] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2020] [Revised: 03/31/2020] [Accepted: 03/31/2020] [Indexed: 12/12/2022]
Abstract
The ability to detect users' emotions for the purpose of emotion engineering is currently one of the main endeavors of machine learning in affective computing. Among the more common approaches to emotion detection are methods that rely on electroencephalography (EEG), facial image processing and speech inflections. Although eye-tracking is fast in becoming one of the most commonly used sensor modalities in affective computing, it is still a relatively new approach for emotion detection, especially when it is used exclusively. In this survey paper, we present a review on emotion recognition using eye-tracking technology, including a brief introductory background on emotion modeling, eye-tracking devices and approaches, emotion stimulation methods, the emotional-relevant features extractable from eye-tracking data, and most importantly, a categorical summary and taxonomy of the current literature which relates to emotion recognition using eye-tracking. This review concludes with a discussion on the current open research problems and prospective future research directions that will be beneficial for expanding the body of knowledge in emotion detection using eye-tracking as the primary sensor modality.
Collapse
Affiliation(s)
- Jia Zheng Lim
- Evolutionary Computing Laboratory, Faculty of Computing and Informatics, Universiti Malaysia Sabah, Jalan UMS, Kota Kinabalu 88400, Sabah, Malaysia;
| | - James Mountstephens
- Faculty of Computing and Informatics, Universiti Malaysia Sabah, Jalan UMS, Kota Kinabalu 88400, Sabah, Malaysia;
| | - Jason Teo
- Faculty of Computing and Informatics, Universiti Malaysia Sabah, Jalan UMS, Kota Kinabalu 88400, Sabah, Malaysia;
| |
Collapse
|
24
|
Flynn M, Effraimidis D, Angelopoulou A, Kapetanios E, Williams D, Hemanth J, Towell T. Assessing the Effectiveness of Automated Emotion Recognition in Adults and Children for Clinical Investigation. Front Hum Neurosci 2020; 14:70. [PMID: 32317947 PMCID: PMC7156005 DOI: 10.3389/fnhum.2020.00070] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Accepted: 02/17/2020] [Indexed: 12/04/2022] Open
Abstract
Recent success stories in automated object or face recognition, partly fuelled by deep learning artificial neural network (ANN) architectures, have led to the advancement of biometric research platforms and, to some extent, the resurrection of Artificial Intelligence (AI). In line with this general trend, inter-disciplinary approaches have been taken to automate the recognition of emotions in adults or children for the benefit of various applications, such as identification of children's emotions prior to a clinical investigation. Within this context, it turns out that automating emotion recognition is far from being straightforward, with several challenges arising for both science (e.g., methodology underpinned by psychology) and technology (e.g., the iMotions biometric research platform). In this paper, we present a methodology and experiment and some interesting findings, which raise the following research questions for the recognition of emotions and attention in humans: (a) the adequacy of well-established techniques such as the International Affective Picture System (IAPS), (b) the adequacy of state-of-the-art biometric research platforms, (c) the extent to which emotional responses may be different in children and adults. Our findings and first attempts to answer some of these research questions are based on a mixed sample of adults and children who took part in the experiment, resulting in a statistical analysis of numerous variables. These are related to both automatically and interactively captured responses of participants to a sample of IAPS pictures.
Collapse
Affiliation(s)
- Maria Flynn
- School of Social Sciences, University of Westminster, London, United Kingdom
| | - Dimitris Effraimidis
- School of Computer Science and Engineering, University of Westminster, London, United Kingdom
| | - Anastassia Angelopoulou
- School of Computer Science and Engineering, University of Westminster, London, United Kingdom
| | - Epaminondas Kapetanios
- School of Computer Science and Engineering, University of Westminster, London, United Kingdom
| | - David Williams
- School of Social Sciences, University of Westminster, London, United Kingdom
| | - Jude Hemanth
- ECE Department, Karunya Institute of Technology and Sciences, Coimbatore, India
| | - Tony Towell
- School of Social Sciences, University of Westminster, London, United Kingdom
| |
Collapse
|
25
|
Emotional Status and Productivity: Evidence from the Special Economic Zone in Laos. SUSTAINABILITY 2020. [DOI: 10.3390/su12041544] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Employee productivity is a well-studied area, which has been explained in various dimensions. However, there is insufficient research on how workers’ on-job emotional status relates to productivity. This study examined the relationship between workers’ emotional states and productivity by assessing on-job emotionality recorded using a specially designed wearable biometric device. The experiment was conducted at KP Beau Lao Co. Ltd., a Japanese plastic toys and cosmetic products company in Savannakhet province in Southwestern Laos. Participants were 15 plastic toy painters. Mental status, daily output, and other issues were recorded for three consecutive working days. Using random effects panel regression models, we examined how productivity, operationalized as the log of daily output, was related to workers’ emotional states, including the amount of time workers reported being happy, angry, relaxed, and sad. We controlled for conversation time, heart rate, and other demographic features. The results revealed that happiness, and no other emotional state, was significantly and positively related to productivity. Such findings suggested that workers’ emotional states must be addressed as part of an organization’s operational strategy to ensure higher productivity.
Collapse
|
26
|
Abstract
A novel two-dimensional matrix taxonomy, or atlas, of personality, emotion and behaviour is presented. The two dimensions of the atlas, affiliation and dominance, are demonstrated to have theoretical foundations in neurobiology and social psychology. Both dimensions are divided into five ordinal categories, creating a square matrix of 25 cells. A new catalogue of 20,669 English words descriptive of personality, emotion, behaviour, and power is also presented. The catalogue is more comprehensive than previous catalogues, and is novel in its inclusion of intrapersonal, group, and societal behaviours. All words in the catalogue were scored according to the atlas, facilitating visualisation in two dimensions. This enabled a contiguous and novel comparison of existing psychological taxonomies, as well as broader societal concepts such as leadership, ethics, and crime. Using the atlas, a novel psychological test is developed with improved sensitivity and specificity.
Collapse
Affiliation(s)
- Anthony E. D. Mobbs
- Department of Psychology, Faculty of Human Sciences, Macquarie University, Sydney, New South Wales, Australia
| |
Collapse
|
27
|
|
28
|
Salgado S, Kingo OS. How is physiological arousal related to self-reported measures of emotional intensity and valence of events and their autobiographical memories? Conscious Cogn 2019; 75:102811. [PMID: 31525715 DOI: 10.1016/j.concog.2019.102811] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2019] [Revised: 08/26/2019] [Accepted: 08/26/2019] [Indexed: 11/29/2022]
Abstract
Research suggests that emotionally intense experiences that elicit higher-than-average physiological arousal responses lead to particularly durable and detailed autobiographical memories. Yet, the lack of objective measures of physiological arousal while events unfold in everyday life makes it hard to corroborate this lab finding. Also, it is uncertain how well arousal maps onto self-reports of the phenomenological characteristics of autobiographical events and memories. Here, we examined how physiological measures of arousal, taken while everyday life events develop, correlate with self-reports. Our results showed that physiological arousal during an event not only was related to self-evaluations of its assessed physical reaction -at the time of report-, but also predicted evaluations of physical reaction, positivity, and importance of their memories one week after. Further analyses revealed that, while arousal affected evaluations of emotional intensity of events and memories, this relationship was moderated by participants' level of awareness about their own emotional processes.
Collapse
Affiliation(s)
- Sinué Salgado
- Aarhus University, Department of Psychology, Center on Autobiographical Memory Research, Denmark.
| | - Osman Skjold Kingo
- Aarhus University, Department of Psychology, Center on Autobiographical Memory Research, Denmark
| |
Collapse
|
29
|
Reynolds RM, Novotny E, Lee J, Roth D, Bente G. Ambiguous Bodies: The Role of Displayed Arousal in Emotion [Mis]Perception. JOURNAL OF NONVERBAL BEHAVIOR 2019. [DOI: 10.1007/s10919-019-00312-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
30
|
Ćoso B, Guasch M, Ferré P, Hinojosa JA. Affective and concreteness norms for 3,022 Croatian words. Q J Exp Psychol (Hove) 2019; 72:2302-2312. [PMID: 30744508 DOI: 10.1177/1747021819834226] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
This study presents subjective ratings for 3,022 Croatian words, which were evaluated on two affective dimensions (valence and arousal) and one lexico-semantic variable (concreteness). A sample of 933 Croatian native speakers rated the words online. Ratings showed high reliabilities for all three variables, as well as significant correlations with ratings from databases available in Spanish and English. A quadratic relation between valence and arousal was observed, with a tendency for arousal to increase for negative and positive words, and neutral words having the lowest arousal ratings. In addition, significant correlations were found between affective dimensions and word concreteness, suggesting that abstract words have a tendency to be more arousing and emotional than concrete words. The present database will allow experimental research in Croatian, a language with a considerable lack of psycholinguistic norms, by providing researchers with a useful tool in the investigation of the relationship between language and emotion for the South-Slavic group of languages.
Collapse
Affiliation(s)
- Bojana Ćoso
- 1 Department of Psychology, Faculty of Humanities and Social Sciences, University of Rijeka, Rijeka, Croatia
| | - Marc Guasch
- 2 Department of Psychology, Research Center for Behavior Assessment, Universitat Rovira i Virgili, Tarragona, Spain
| | - Pilar Ferré
- 2 Department of Psychology, Research Center for Behavior Assessment, Universitat Rovira i Virgili, Tarragona, Spain
| | - José Antonio Hinojosa
- 3 Facultad de Psicología, Instituto Pluridisciplinar, Universidad Complutense de Madrid, Madrid, Spain
| |
Collapse
|
31
|
Shen C, Wang M, Ding T, Yang Y, Cabanyes-Truffino J, Sun L, Wang C, Wang W. Basic emotions expressed in music: factor analyses on intensity ratings by non-musical professional Chinese university students. Psychol Res Behav Manag 2018; 11:617-629. [PMID: 30588136 PMCID: PMC6294065 DOI: 10.2147/prbm.s190038] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND Previous studies of musical emotion largely depended on the lexical approach which suffered from overlaps between emotions. METHODS In the present study, we explored emotional domains through a dimensional approach based on the intensity ratings on the emotion perceived in music. Altogether, 488 university students were invited to listen to 60 musical excerpts (most of them classical), to rate the intensity of emotion perceived without naming the emotion. Later, we conducted the exploratory factor analysis on the intensity ratings to look for the latent structures of musical emotion and then applied the confirmatory factor analysis to verify the validity of the proposed model of emotional structure. RESULTS After first- and second-order factor analyses, seven emotional factors (domains, with 38 musical excerpts) were identified: Happiness, Tenderness, Sadness, Passion, Anger, Anxiousness, and Depression, which formed a satisfactory model. No gender difference was found regarding the perceived intensity of musical emotion. CONCLUSION Our study has offered evidence to delineate basic musical emotions into seven domains.
Collapse
Affiliation(s)
- Chanchan Shen
- Department of Clinical Psychology and Psychiatry, School of Public Health, Zhejiang University College of Medicine, Hangzhou, China,
| | - Mufan Wang
- Faculty of Psychology, Universidad Complutense de Madrid, Madrid, Spain
| | - Tongjun Ding
- Department of Musicology, Qianjiang College, Hangzhou Normal University, Hangzhou, China
| | - Yang Yang
- Department of Musicology, College of Arts and Communications, Anhui University, Hefei, China
| | | | - Lijun Sun
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Chu Wang
- Department of Clinical Psychology and Psychiatry, School of Public Health, Zhejiang University College of Medicine, Hangzhou, China,
| | - Wei Wang
- Department of Clinical Psychology and Psychiatry, School of Public Health, Zhejiang University College of Medicine, Hangzhou, China,
| |
Collapse
|
32
|
Xu ML, De Boeck P, Strunk D. An affective space view on depression and anxiety. Int J Methods Psychiatr Res 2018; 27:e1747. [PMID: 30338590 PMCID: PMC6877283 DOI: 10.1002/mpr.1747] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2018] [Revised: 07/16/2018] [Accepted: 09/10/2018] [Indexed: 11/06/2022] Open
Abstract
The circumplex model for core affect is among the most prominent characterizations of emotion and has received extensive empirical support. However, no prior study exists that connects the measurement of depression and anxiety with the core affect structure and the bipolar dimensions of arousal and valence it includes. OBJECTIVES This study aims to investigate the reconcilability between a continuous model based on Russell's core affect system and a discrete entity view on depression and anxiety. METHODS The data were drawn from the anxiety and depression short forms in the Patient-Reported Outcomes Measurement Information System (N = 763). It consists of 15 items with a 5-point Likert scale. Ratings of the items in terms of distress and arousal were obtained from experts in emotion research. An approach based on Russell's core affect theory was compared with the common type of factor models in which the items are lined up on clearly separated depression and anxiety dimensions with an empty space in between, as if they are separate and discrete entities. Our alternative model works with a continuous space instead. RESULTS The core affect theory-based method exhibits a goodness of fit that is comparable with the conventional models. CONCLUSIONS Depression and anxiety can be understood in terms of Russell's bipolar core affect model; the core affect-based model leaves room for symptoms in the space between dimensions.
Collapse
|
33
|
Abstract
Appraisal theories of emotion, and particularly the Component Process Model, have claimed over the past three decades that the different components of the emotion process (action tendencies, physiological reactions, expressions, and feeling experiences) are essentially driven by the results of multi-level cognitive appraisals and that the feeling component constitutes a central integration and representation of these processes. Given the complexity of the proposed architecture of emotion generation, comprehensive experimental tests of these predictions are difficult to perform and thus evidence has been slow to appear. Complementing earlier work on self-reported appraisal, a massive amount of empirical results from studies with experimental designs based on appraisal manipulation, using electroencephalographic and electromyographic measures, now confirms many of the theoretical predictions with respect to the effect of different appraisal checks, their interactions, and their exact timing. A major issue for future research is the nature of the coherence or synchronisation of the appraisal-driven components in the unfolding emotion process. It is suggested that interdisciplinary multi-team research will be needed to face the theoretical and methodological challenges of experimentally investigating the dynamics of the emotion process.
Collapse
Affiliation(s)
- Klaus R Scherer
- a Department of Psychology , University of Geneva , Geneva , Switzerland.,b Department of Psychology , Ludwig-Maximilians-University of Munich , Munich , Germany
| |
Collapse
|
34
|
Li Y, Li J, Akagi M. Contributions of the glottal source and vocal tract cues to emotional vowel perception in the valence-arousal space. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2018; 144:908. [PMID: 30180717 DOI: 10.1121/1.5051323] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/12/2018] [Accepted: 08/06/2018] [Indexed: 06/08/2023]
Abstract
Motivated by the source-filter model of speech production, analysis of emotional speech based on the inverse-filtering method has been extensively conducted. The relative contribution of the glottal source and vocal tract cues to perception of emotions in speech is still unclear, especially after removing the effects of the known dominant factors (e.g., F0, intensity, and duration). In this present study, the glottal source and vocal tract parameters were estimated in a simultaneous manner, modified in a controlled way and then used for resynthesizing emotional Japanese vowels by applying a recently developed analysis-by-synthesis method. The resynthesized emotional vowels were presented to native Japanese listeners with normal hearing for perceptually rating emotions in valence and arousal dimensions. Results showed that glottal source information played a dominant role in perception of emotions in vowels, while vocal tract information contributed to valence and arousal perceptions after neutralizing the effects of F0, intensity, and duration cues.
Collapse
Affiliation(s)
- Yongwei Li
- School of Information Science, Japan Advanced Institute of Science and Technology, 1-1 Asahidai, Nomi, Ishikawa 923-1292, Japan
| | - Junfeng Li
- Institute of Acoustics, Chinese Academy of Sciences, 21 North 4th Ring Road, Haidian District, Beijing 100190, People's Republic of China
| | - Masato Akagi
- School of Information Science, Japan Advanced Institute of Science and Technology, 1-1 Asahidai, Nomi, Ishikawa 923-1292, Japan
| |
Collapse
|
35
|
Maki H, Sakti S, Tanaka H, Nakamura S. Quality prediction of synthesized speech based on tensor structured EEG signals. PLoS One 2018; 13:e0193521. [PMID: 29902169 PMCID: PMC6002021 DOI: 10.1371/journal.pone.0193521] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2017] [Accepted: 02/13/2018] [Indexed: 12/01/2022] Open
Abstract
This study investigates quality prediction methods for synthesized speech using EEG. Training a predictive model using EEG is challenging due to a small number of training trials, a low signal-to-noise ratio, and a high correlation among independent variables. When a predictive model is trained with a machine learning algorithm, the features extracted from multi-channel EEG signals are usually organized as a vector and their structures are ignored even though they are highly structured signals. This study predicts the subjective rating scores of synthesized speeches, including their overall impression, valence, and arousal, by creating tensor structured features instead of vectorized ones to exploit the structure of the features. We extracted various features to construct a tensor feature that maintained their structure. Vectorized and tensorial features were used to predict the rating scales, and the experimental result showed that prediction with tensorial features achieved the better predictive performance. Among the features, the alpha and beta bands are particularly more effective for predictions than other features, which agrees with previous neurophysiological studies.
Collapse
Affiliation(s)
- Hayato Maki
- Graduate School of Information Sciences, Nara Institue of Science and Technology, Ikoma, Nara, Japan
| | - Sakriani Sakti
- Graduate School of Information Sciences, Nara Institue of Science and Technology, Ikoma, Nara, Japan
| | - Hiroki Tanaka
- Graduate School of Information Sciences, Nara Institue of Science and Technology, Ikoma, Nara, Japan
| | - Satoshi Nakamura
- Graduate School of Information Sciences, Nara Institue of Science and Technology, Ikoma, Nara, Japan
| |
Collapse
|
36
|
Gong X, Wong N, Wang D. Are Gender Differences in Emotion Culturally Universal? Comparison of Emotional Intensity Between Chinese and German Samples. JOURNAL OF CROSS-CULTURAL PSYCHOLOGY 2018. [DOI: 10.1177/0022022118768434] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Are gender differences in emotion culturally universal? To answer this question, the current study compared gender differences in emotional arousal (intensity) ratings for negative and positive pictures from the International Affective Picture System (IAPS) across cultures (Chinese vs. German culture) and age (younger vs. older adults). The raters were 53 younger Germans (24 women), 53 older Germans (28 women), 300 younger Chinese (176 women), and 126 older Chinese (86 women). The results showed that gender differences in arousal ratings were moderated by culture and age: Chinese women reported higher arousal for both negative and positive pictures compared with Chinese men; German women reported higher arousal for negative pictures, but lower arousal for positive pictures compared with German men. Moreover, the gender differences were larger for older than younger adults in the Chinese sample but smaller for older than younger adults in the German sample. The results indicated that gender differences in self-report emotional intensity induced by pictorial stimuli were more consistent with gender norms and stereotypes (i.e., women being more emotional than men) in the Chinese sample, compared with the German sample, and that gender differences were not constant across age groups. The study revealed that gender differences in emotion are neither constant nor universal, and it highlighted the importance of taking culture and age into account.
Collapse
|
37
|
|
38
|
Auracher J. Sound iconicity of abstract concepts: Place of articulation is implicitly associated with abstract concepts of size and social dominance. PLoS One 2017; 12:e0187196. [PMID: 29091943 PMCID: PMC5665516 DOI: 10.1371/journal.pone.0187196] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2016] [Accepted: 10/16/2017] [Indexed: 11/23/2022] Open
Abstract
The concept of sound iconicity implies that phonemes are intrinsically associated with non-acoustic phenomena, such as emotional expression, object size or shape, or other perceptual features. In this respect, sound iconicity is related to other forms of cross-modal associations in which stimuli from different sensory modalities are associated with each other due to the implicitly perceived correspondence of their primal features. One prominent example is the association between vowels, categorized according to their place of articulation, and size, with back vowels being associated with bigness and front vowels with smallness. However, to date the relative influence of perceptual and conceptual cognitive processing on this association is not clear. To bridge this gap, three experiments were conducted in which associations between nonsense words and pictures of animals or emotional body postures were tested. In these experiments participants had to infer the relation between visual stimuli and the notion of size from the content of the pictures, while directly perceivable features did not support–or even contradicted–the predicted association. Results show that implicit associations between articulatory-acoustic characteristics of phonemes and pictures are mainly influenced by semantic features, i.e., the content of a picture, whereas the influence of perceivable features, i.e., size or shape, is overridden. This suggests that abstract semantic concepts can function as an interface between different sensory modalities, facilitating cross-modal associations.
Collapse
Affiliation(s)
- Jan Auracher
- Department for Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt aM, Germany
- * E-mail:
| |
Collapse
|
39
|
Otgaar H, Muris P, Howe ML, Merckelbach H. What Drives False Memories in Psychopathology? A Case for Associative Activation. Clin Psychol Sci 2017; 5:1048-1069. [PMID: 29170722 PMCID: PMC5665161 DOI: 10.1177/2167702617724424] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/08/2017] [Accepted: 07/12/2017] [Indexed: 11/17/2022]
Abstract
In clinical and court settings, it is imperative to know whether posttraumatic stress disorder (PTSD) and depression may make people susceptible to false memories. We conducted a review of the literature on false memory effects in participants with PTSD, a history of trauma, or depression. When emotional associative material was presented to these groups, their levels of false memory were raised relative to those in relevant comparison groups. This difference did not consistently emerge when neutral or nonassociative material was presented. Our conclusion is supported by a quantitative comparison of effect sizes between studies using emotional associative or neutral, nonassociative material. Our review suggests that individuals with PTSD, a history of trauma, or depression are at risk for producing false memories when they are exposed to information that is related to their knowledge base.
Collapse
Affiliation(s)
| | - Peter Muris
- Maastricht University
- Stellenbosch University
| | | | | |
Collapse
|
40
|
Grootswagers T, Kennedy BL, Most SB, Carlson TA. Neural signatures of dynamic emotion constructs in the human brain. Neuropsychologia 2017; 145:106535. [PMID: 29037506 DOI: 10.1016/j.neuropsychologia.2017.10.016] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2017] [Revised: 10/10/2017] [Accepted: 10/12/2017] [Indexed: 12/20/2022]
Abstract
How is emotion represented in the brain: is it categorical or along dimensions? In the present study, we applied multivariate pattern analysis (MVPA) to magnetoencephalography (MEG) to study the brain's temporally unfolding representations of different emotion constructs. First, participants rated 525 images on the dimensions of valence and arousal and by intensity of discrete emotion categories (happiness, sadness, fear, disgust, and sadness). Thirteen new participants then viewed subsets of these images within an MEG scanner. We used Representational Similarity Analysis (RSA) to compare behavioral ratings to the unfolding neural representation of the stimuli in the brain. Ratings of valence and arousal explained significant proportions of the MEG data, even after corrections for low-level image properties. Additionally, behavioral ratings of the discrete emotions fear, disgust, and happiness significantly predicted early neural representations, whereas rating models of anger and sadness did not. Different emotion constructs also showed unique temporal signatures. Fear and disgust - both highly arousing and negative - were rapidly discriminated by the brain, but disgust was represented for an extended period of time relative to fear. Overall, our findings suggest that 1) dimensions of valence and arousal are quickly represented by the brain, as are some discrete emotions, and 2) different emotion constructs exhibit unique temporal dynamics. We discuss implications of these findings for theoretical understanding of emotion and for the interplay of discrete and dimensional aspects of emotional experience.
Collapse
|
41
|
Otgaar H, Howe ML, Muris P. Maltreatment increases spontaneous false memories but decreases suggestion-induced false memories in children. BRITISH JOURNAL OF DEVELOPMENTAL PSYCHOLOGY 2017; 35:376-391. [PMID: 28093783 PMCID: PMC5573940 DOI: 10.1111/bjdp.12177] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2016] [Revised: 12/16/2016] [Indexed: 12/02/2022]
Abstract
We examined the creation of spontaneous and suggestion‐induced false memories in maltreated and non‐maltreated children. Maltreated and non‐maltreated children were involved in a Deese–Roediger–McDermott false memory paradigm where they studied and remembered negative and neutral word lists. Suggestion‐induced false memories were created using a misinformation procedure during which both maltreated and non‐maltreated children viewed a negative video (i.e., bank robbery) and later received suggestive misinformation concerning the event. Our results showed that maltreated children had higher levels of spontaneous negative false memories but lower levels of suggestion‐induced false memories as compared to non‐maltreated children. Collectively, our study demonstrates that maltreatment both increases and decreases susceptibility to memory illusions depending on the type of false memory being induced.
|