Validation of video stimuli for basic emotion elicitation : A multimodal approach using self-reports and physiological signals
*Vilas MachhiCorresponding authorvilas.machhi-cse@msubaroda.ac.inDepartment of Computer Science & EngineeringThe M S University of BarodaVadodara, Gujarat, 390001, IndiaView full profile → , Apurva Shahapurva.shah-cse@msubaroda.ac.inDepartment of Computer Science & EngineeringThe M S University of BarodaVadodara, Gujarat, 390001, IndiaView full profile →
* Corresponding author · click or hover a name for details
- Received:
- 01 Oct 2025
- Published Online:
- 18 May 2026
- Article type:
- Research Article
- Language:
- EN
- Article no.:
- JIOS-2226
- Pages:
- 2465–2489
Abstract
Keywords
Subject Classifications
References
[1] R. W. Picard, Affective Computing. Cambridge, MA, USA: MIT Press (1997).
[2] J. Tao and T. Tan, “Affective computing: A review,” in Proc. Int. Conf. Machine Learning and Cybernetics, vol. 1, pp. 151–156 (2005).
[3] R. A. Calvo and S. K. D’Mello, “Affective computing and education: Learning about emotions,” IEEE Trans. Affective Computing, vol. 1, no. 1, pp. 18–30 (2010).
[4] B. Kort, R. Reilly, and R. W. Picard, “An affective model of interplay between emotions and learning: Reengineering educational pedagogy-building a learning companion,” in Proc. IEEE Int. Conf. Advanced Learning Technologies (ICALT), pp. 6–9 (2001).
[5] K. Hone and J. Patrick, “Affective computing for mental health,” Int. J. Human-Computer Studies, vol. 70, no. 6, pp. 337–340 (2012).
[6] J. Gratch and S. Marsella, “A social appraisal framework for emotion,” Autonomous Agents and Multi-Agent Systems, vol. 8, no. 3, pp. 173–197 (2004).
[7] M. Pantic and L. J. M. Rothkrantz, “Automatic analysis of facial expressions: The state of the art,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 12, pp. 1424–1445 (2000).
[8] K. R. Scherer, “Psychological models of emotion,” in The Neuropsychology of Emotion, J. C. Borod, Ed. Oxford, U.K.: Oxford Univ. Press, pp. 137–162 (2000).
[9] J. A. Coan and J. J. B. Allen, Handbook of Emotion Elicitation and Assessment. Oxford, U.K.: Oxford Univ. Press (2007).
[10] J. J. Gross and R. W. Levenson, “Emotion elicitation using films,” Cognition & Emotion, vol. 9, no. 1, pp. 87–107 (1995).
[11] M. M. Bradley and P. J. Lang, Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings. Gainesville, FL, USA: Center for Research in Psychophysiology, Univ. of Florida (1999).
[12] G. Stemmler, M. Heldmann, A. Pauls, and K. R. Scherer, “Constraints on emotion elicitation by affective pictures,” Psychophysiology, vol. 38, no. 2, pp. 295–306 (2001).
[13] S. Vieillard, I. Peretz, and P. Boucher, “A study of the emotional impact of music on physiological arousal,” Psychophysiology, vol. 47, no. 4, pp. 629–638 (2010).
[14] H. C. Lench, S. A. Flores, and S. W. Bench, “Discrete emotions predict behavior and judgment: A meta-analytic review,” Psychological Bulletin, vol. 137, no. 5, pp. 834–855 (2011).
[15] P. Philippot, “The effect of emotion on the production of facial expression: A review of the literature,” Int. J. Psychophysiology, vol. 14, no. 3, pp. 171–182 (1993).
[16] A. Schaefer, F. Nils, X. Sanchez, and P. Philippot, “Assessing the effectiveness of a large database of emotion-eliciting films: A new tool for emotion research,” Behavior Research Methods, vol. 42, no. 4, pp. 932–942 (2010).
[17] J. Rottenberg, R. D. Ray, and J. J. Gross, “Emotion elicitation using films,” in Handbook of Emotion Elicitation and Assessment, J. A. Coan and J. J. B. Allen, Eds. Oxford, U.K.: Oxford Univ. Press, pp. 9–28 (2007).
[18] M. Soleymani, J. Lichtenauer, T. Pun, and M. Pantic, “A multimodal database for affect recognition in naturalistic environments,” IEEE Trans. Affective Computing, vol. 3, no. 1, pp. 47–63 (2012).
[19] S. Koelstra et al., “DEAP: A database for emotion analysis using physiological signals,” IEEE Trans. Affective Computing, vol. 3, no. 1, pp. 18–31 (2012).
[20] J. Lu, C. Ma, and J. Zhang, “Challenges and advancements in emotion recognition,” J. Visual Communication and Image Representation, vol. 45, pp. 107–118 (2017).
[21] J. Wagner, K. R. Scherer, and T. Bänziger, “The Geneva Multimodal Emotion Portrayals (GEMEP) corpus: An emotion-eliciting video database,” IEEE Trans. Affective Computing, vol. 5, no. 2, pp. 177–189 (2014).
[22] P. Ekman, “An argument for basic emotions,” Cognition & Emotion, vol. 6, no. 3–4, pp. 169–200 (1992).
[23] P. Ekman and W. V. Friesen, Facial Action Coding System: A Technique for the Measurement of Facial Movement. Palo Alto, CA, USA: Consulting Psychologists Press (1978).
[24] I. B. Mauss and M. D. Robinson, “Measures of emotion: A review,” Cognition & Emotion, vol. 23, no. 2, pp. 209–237 (2009).
[25] D. Watson, L. A. Clark, and A. Tellegen, “Development and validation of brief measures of positive and negative affect: The PANAS scales,” J. Personality and Social Psychology, vol. 54, no. 6, pp. 1063–1070 (1988).
[26] P. N. Juslin and K. R. Scherer, Eds., Handbook of Music and Emotion: Theory, Research, Applications. Oxford, U.K.: Oxford Univ. Press (2008).
[27] J. R. Landis and G. G. Koch, “The measurement of observer agreement for categorical data,” Biometrics, vol. 33, no. 1, pp. 159–174 (1977).
[28] J. A. Russell, “A circumplex model of affect,” J. Personality and Social Psychology, vol. 39, no. 6, pp. 1161–1178 (1980).
[29] P. J. Lang, M. M. Bradley, and B. N. Cuthbert, International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual. Gainesville, FL, USA: Univ. of Florida (2008).
[30] E. T. Rolls, Emotion and Decision-Making Explained. Oxford, U.K.: Oxford Univ. Press (2014).
[31] C. D. Katsis, Y. Goletsis, and D. I. Fotiadis, “An integrated approach for emotion recognition using physiological signals and self-assessment,” IEEE Trans. Information Technology in Biomedicine, vol. 15, no. 3, pp. 370–377 (2011).
[32] B. Ramani, W. Patel, and K. Solanki, “Stress Ocare: An advance IoMT based physiological data analysis for anxiety status prediction using cloud computing,” J. Discrete Mathematical Sciences and Cryptography, vol. 25, no. 4, pp. 1019–1029 (2022). doi: 10.1080/09720529.2022.2072426.
