Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation

Hyejeong Jo, Junhyeok Lee, Hye Won Park, Minjae Kim, Yeonwoo Kim, Won Hee Lee

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The evaluation of user experience (UX) is a multifaceted process that encompasses a range of methods such as surveys, emotion recognition, and attention recognition. The effectiveness of UX evaluation depends on the integration of dependable and unbiased techniques derived from diverse user-generated data sources. In this context, we introduce a Multimodal INteractive Dashboard (MIND), a web-based platform tailored to furnish a reliable and user-centric avenue for UX evaluation. MIND incorporates three core functionalities: facial emotion recognition, EEG-based attention recognition, and image generation informed by estimated user's poses and affective states. By seamlessly engaging users, MIND facilitates a quantitative assessment of their experiences. The proposed MIND offers multimodal data analytics and visualization to enable insights of time spans of the UX with individual users, helping improve the overall user experience.

Original languageEnglish
Title of host publication2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350344318
DOIs
StatePublished - 2023
Externally publishedYes
Event2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023 - Busan, Korea, Republic of
Duration: 23 Oct 202325 Oct 2023

Publication series

Name2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023

Conference

Conference2023 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2023
Country/TerritoryKorea, Republic of
CityBusan
Period23/10/2325/10/23

Keywords

  • EEG
  • User experience
  • attention
  • dashboard
  • facial emotion recognition
  • image generation
  • pose estimation

Fingerprint

Dive into the research topics of 'Developing an Integrated Dashboard to Analyze Multimodal Data for User Experience Evaluation'. Together they form a unique fingerprint.

Cite this