2024
Matey-Sanz, Miguel
Human Activity Recognition with Consumer Devices and Real-Life Perspectives PhD Thesis
2024.
Abstract | Links | BibTeX | Tags: activity recognition, machine learning, smartphone app, smartwatch
@phdthesis{Matey2024c,
title = {Human Activity Recognition with Consumer Devices and Real-Life Perspectives},
author = {Miguel Matey-Sanz},
doi = {http://dx.doi.org/10.6035/14101.2024.663821},
year = {2024},
date = {2024-10-30},
abstract = {During the last decade, research on human activity recognition has grown due to its applications in diverse fields such as video surveillance, exercise monitoring or health monitoring systems. In the latter case, researchers are putting their efforts into using human activity recognition in monitoring elderly people, for example, for fall prevention and detection applications. Existing research usually has drawbacks regarding their requirements regarding sensing devices (e.g., cost, quantity, location). Therefore, research needs to keep these drawbacks in mind to have a real impact on society. This thesis addresses the abovementioned issue by focusing on the feasibility of the use of consumer devices such as smartphones and smartwatches, and cheap devices like microcontrollers, for human activity recognition and its application in real-life problems.},
keywords = {activity recognition, machine learning, smartphone app, smartwatch},
pubstate = {published},
tppubtype = {phdthesis}
}
During the last decade, research on human activity recognition has grown due to its applications in diverse fields such as video surveillance, exercise monitoring or health monitoring systems. In the latter case, researchers are putting their efforts into using human activity recognition in monitoring elderly people, for example, for fall prevention and detection applications. Existing research usually has drawbacks regarding their requirements regarding sensing devices (e.g., cost, quantity, location). Therefore, research needs to keep these drawbacks in mind to have a real impact on society. This thesis addresses the abovementioned issue by focusing on the feasibility of the use of consumer devices such as smartphones and smartwatches, and cheap devices like microcontrollers, for human activity recognition and its application in real-life problems.
2023
Matey-Sanz, Miguel; Casteleyn, Sven; Granell-Canut, Carlos
Dataset of inertial measurements of smartphones and smartwatches for human activity recognition Journal Article
In: Data in Brief, vol. 51, pp. 109809, 2023, ISSN: 2352-3409.
Abstract | Links | BibTeX | Tags: activity recognition, dataset, machine learning, smartphone app, smartwatch, symptoms
@article{Matey2023c,
title = {Dataset of inertial measurements of smartphones and smartwatches for human activity recognition},
author = {Miguel Matey-Sanz and Sven Casteleyn and Carlos Granell-Canut},
doi = {https://doi.org/10.1016/j.dib.2023.109809},
issn = {2352-3409},
year = {2023},
date = {2023-12-15},
journal = {Data in Brief},
volume = {51},
pages = {109809},
abstract = {This article describes a dataset for human activity recognition with inertial measurements, i.e., accelerometer and gyroscope, from a smartphone and a smartwatch placed in the left pocket and on the left wrist, respectively. Twenty-three heterogeneous subjects (μ = 44.3, σ = 14.3, 56% male) participated in the data collection, which consisted of performing five activities (seated, standing up, walking, turning, and sitting down) arranged in a specific sequence (corresponding with the TUG test). Subjects performed the sequence of activities multiple times while the devices collected inertial data at 100 Hz and were video-recorded by a researcher for data labelling purposes. The goal of this dataset is to provide smartphone- and smartwatch-based inertial data for human activity recognition collected from a heterogeneous (i.e., age-diverse, gender-balanced) set of subjects. Along with the dataset, the repository includes demographic information (age, gender), information about each sequence of activities (smartphone's orientation in the pocket, direction of turns), and a Python package with utility functions (data loading, visualization, etc). The dataset can be reused for different purposes in the field of human activity recognition, from cross-subject evaluation to comparison of recognition performance using data from smartphones and smartwatches.},
keywords = {activity recognition, dataset, machine learning, smartphone app, smartwatch, symptoms},
pubstate = {published},
tppubtype = {article}
}
This article describes a dataset for human activity recognition with inertial measurements, i.e., accelerometer and gyroscope, from a smartphone and a smartwatch placed in the left pocket and on the left wrist, respectively. Twenty-three heterogeneous subjects (μ = 44.3, σ = 14.3, 56% male) participated in the data collection, which consisted of performing five activities (seated, standing up, walking, turning, and sitting down) arranged in a specific sequence (corresponding with the TUG test). Subjects performed the sequence of activities multiple times while the devices collected inertial data at 100 Hz and were video-recorded by a researcher for data labelling purposes. The goal of this dataset is to provide smartphone- and smartwatch-based inertial data for human activity recognition collected from a heterogeneous (i.e., age-diverse, gender-balanced) set of subjects. Along with the dataset, the repository includes demographic information (age, gender), information about each sequence of activities (smartphone's orientation in the pocket, direction of turns), and a Python package with utility functions (data loading, visualization, etc). The dataset can be reused for different purposes in the field of human activity recognition, from cross-subject evaluation to comparison of recognition performance using data from smartphones and smartwatches.
Matey-Sanz, Miguel; Torres-Sospedra, Joaquín; González-Pérez, Alberto; Casteleyn, Sven; Granell-Canut, Carlos
Analysis and Impact of Training Set Size in Cross-Subject Human Activity Recognition Proceedings Article
In: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, pp. 391–405, Springer, Cham, 2023, ISBN: 978-3-031-49018-7.
Abstract | Links | BibTeX | Tags: activity recognition, machine learning, smartphone app, smartwatch, symptoms
@inproceedings{Matey2023b,
title = {Analysis and Impact of Training Set Size in Cross-Subject Human Activity Recognition},
author = {Miguel Matey-Sanz and Joaquín Torres-Sospedra and Alberto González-Pérez and Sven Casteleyn and Carlos Granell-Canut},
doi = {https://doi.org/10.1007/978-3-031-49018-7_28},
isbn = {978-3-031-49018-7},
year = {2023},
date = {2023-12-01},
booktitle = {Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications},
volume = {14469},
pages = {391–405},
publisher = {Springer, Cham},
series = {Lecture Notes in Computer Science},
abstract = {The ubiquity of consumer devices with sensing and computational capabilities, such as smartphones and smartwatches, has increased interest in their use in human activity recognition for healthcare monitoring applications, among others. When developing such a system, researchers rely on input data to train recognition models. In the absence of openly available datasets that meet the model requirements, researchers face a hard and time-consuming process to decide which sensing device to use or how much data needs to be collected. In this paper, we explore the effect of the amount of training data on the performance (i.e., classification accuracy and activity-wise F1-scores) of a CNN model by performing an incremental cross-subject evaluation using data collected from a consumer smartphone and smartwatch. Systematically studying the incremental inclusion of subject data from a set of 22 training subjects, the results show that the model’s performance initially improves significantly with each addition, yet this improvement slows down the larger the number of included subjects. We compare the performance of models based on smartphone and smartwatch data. The latter option is significantly better with smaller sizes of training data, while the former outperforms with larger amounts of training data. In addition, gait-related activities show significantly better results with smartphone-collected data, while non-gait-related activities, such as standing up or sitting down, were better recognized with smartwatch-collected data.},
keywords = {activity recognition, machine learning, smartphone app, smartwatch, symptoms},
pubstate = {published},
tppubtype = {inproceedings}
}
The ubiquity of consumer devices with sensing and computational capabilities, such as smartphones and smartwatches, has increased interest in their use in human activity recognition for healthcare monitoring applications, among others. When developing such a system, researchers rely on input data to train recognition models. In the absence of openly available datasets that meet the model requirements, researchers face a hard and time-consuming process to decide which sensing device to use or how much data needs to be collected. In this paper, we explore the effect of the amount of training data on the performance (i.e., classification accuracy and activity-wise F1-scores) of a CNN model by performing an incremental cross-subject evaluation using data collected from a consumer smartphone and smartwatch. Systematically studying the incremental inclusion of subject data from a set of 22 training subjects, the results show that the model’s performance initially improves significantly with each addition, yet this improvement slows down the larger the number of included subjects. We compare the performance of models based on smartphone and smartwatch data. The latter option is significantly better with smaller sizes of training data, while the former outperforms with larger amounts of training data. In addition, gait-related activities show significantly better results with smartphone-collected data, while non-gait-related activities, such as standing up or sitting down, were better recognized with smartwatch-collected data.