Inter and intra signal variance in feature extraction and classification of affective state

Dair, Zachary; Dockray, Samantha; O’Reilly, Ruairi

Inter and intra signal variance in feature extraction and classification of affective state

cb

Files

978-3-031-26438-2_1.pdf(1.62 MB)

Published version

Date

2023-02-23

Authors

Dair, Zachary

Dockray, Samantha

O’Reilly, Ruairi

Publisher

Springer

Published Version

10.1007/978-3-031-26438-2_1

Abstract

Psychophysiology investigates the causal relationship of physiological changes resulting from psychological states. There are significant challenges with machine learning-based momentary assessments of physiology due to varying data collection methods, physiological differences, data availability and the requirement for expertly annotated data. Advances in wearable technology have significantly increased the scale, sensitivity and accuracy of devices for recording physiological signals, enabling large-scale unobtrusive physiological data gathering. This work contributes an empirical evaluation of signal variances acquired from wearables and their associated impact on the classification of affective states by (i) assessing differences occurring in features representative of affective states extracted from electrocardiograms and photoplethysmography, (ii) investigating the disparity in feature importance between signals to determine signal-specific features, and (iii) investigating the disparity in feature importance between affective states to determine affect specific features. Results demonstrate that the degree of feature variance between ECG and PPG in a dataset is reflected in the classification performance of that dataset. Additionally, beats-per-minute, inter-beat interval and breathing rate are identified as common best-performing features across both signals. Finally feature variance per-affective state identifies hard-to-distinguish affective states requiring one-versus-rest or additional features to enable accurate classification.

Keywords

Machine learning , Classification , Psychophysiology , Electrocardiogram , Photoplethysmography , Affective states

Citation

Dair, Z., Dockray, S. and O’Reilly, R. (2023) ‘Inter and intra signal variance in feature extraction and classification of affective state’, AICS2022, in L. Longo and R. O’Reilly (eds) Communications in Computer and Information Science, vol 1662: Springer Nature Switzerland, pp. 3–17. https://doi.org/10.1007/978-3-031-26438-2_1.