Sensory Perception & Interaction Research Group

We investigate how multipass emotion labelling protocols generate ecologically valid dynamic emotion transition labelling of affective touch behaviour (and other modalities). Multipass emotion labels affords emotion metaphors that do not assume static emotion states consisting of scalar values. We demonstrate the construction of emotion labels that distinguish between emotions by transition (best-fit line) -- eg ``anxious getting more stressed'' vs ``anxious but resolving towards relaxed''. Using keypress force (FSR) and brain activity (EEG) data collected from participants playing a horror video game, we trained subject-dependent hierarchical models of contextualized individual experience to compare emotion classification by modality (brain activity and keypress force), reporting benchmark F1-scores=[0.44, 0.82] (chance empirically determined at F1=0.22, sd=0.01).