An Improved Sleeping Posture Recognition Using Pressure Sensor Data and Deep Learning
Main Article Content
Abstract
Many chronic diseases, such as cardiovascular disease and sleep disorders, can be diagnosed and treated by assessing the sleeping quality. Sleep posture recognition is an important part of determining sleep quality in sleep research. While most recent studies focus on the classification problem with the number of sleeping postures being equal to or less than ten, this study aims to achieve state-of-the-art results on 17 in-bed position classification. To do this, a spatial pyramid pooling module was added to the top of the EfficientNet B0 model and the contrastive loss and cross-entropy loss functions are combined to act as the main loss function. The random 10% salt and pepper noise are utilized to augment the training data. Experimental results confirm that the proposed approach achieves the best accuracy of 96.01% and outperforms the existing methods. Additionally, we also provide an estimation related to the impact of various combinations of backbone models and loss functions on the performance of the classifier.
Keywords
sleeping posture classification, pressure sensor data, deep learning
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
References
[1] H. P. Dam, N. D. A. Pham, H. M. Pham, N. P. Doan, D. M. Nguyen and H. H. Nguyen, In-bed posture classification using pressure sensor data and spiking neural network, in Proc. NICS, 2021, pp. 358-363, https://doi.org/ 10.1109/NICS54270.2021.9701;
[2] A. Zhao, J. Dong and H. Zhou, Self-supervised learning from multi-sensor data for sleep recognition, IEEE Access, vol. 8, pp. 93907-93921, 2020, https://doi.org/ 10.1109/ACCESS.2020.2994593;
[3] E. Yu, M. Kenji, Data augmentation to build high performance dnn for in-bed posture classification, Journal of Information Processing, vol. 26, pp. 718-727, 2018, https://doi.org/10.2197/ipsjjip.26.718;
[4] F. J. Costello et al., Exploring a fuzzy rule inferred convlstm for discovering and adjusting the optimal posture of patients with a smart medical bed, Int. J. Envi & Res. Pub Health, 2021, vol. 18, no. 12, pp. 1-14, https://doi.org/10.3390/ijerph1812634;
[5] V. Davoodnia and A. Etemad, Identity and posture recognition in smart beds with deep multitask learning, in Proc. SMC, 2019, pp. 3054-3059, https://doi.org/ 10.1109/SMC.2019.8914459;
[6] N. P. Doan, N. D. A. Pham, H. M. Pham, H. T. Nguyen, T. A. Nguyen and H. H. Nguyen, Real-time sleeping posture recognition for smart hospital beds, in Proc. MAPR, 2021, pp. 1-6, https://doi.org/ 10.1109/MAPR53640.2021.9585289;
[7] K. He, X. Zhang, S. Ren and J. Sun, Spatial pyramid pooling in deep convolutional networks for visual recognition, in Proc. ECCV, 2015, pp. 346-361, https://doi.org/10.1007/978-3-319-10578-9_23;
[8] H. H. Nguyen, T. N. Ta, N. C. Nguyen, V. T. Bui, H. M. Pham and D. M. Nguyen, YOLO based real-time human detection for smart video surveillance at the edge, in Proc. ICCE, 2021, pp. 439-444, https://doi.org/ 10.1109/ICCE48956.2021.9352144;
[9] H. P. Nguyen, T. P. Hoang and H. H. Nguyen, A deep learning based fracture detection in arm bone X-ray images, in Proc. MAPR, pp. 1-6, https://doi.org/ 10.1109/MAPR53640.2021.9585292;
[10] R. Hadsell, S. Chopra and Y. LeCun, Dimensionality reduction by learning an invariant mapping, in Proc. CVPR, 2006, pp. 1735-1742, https://doi.org/ 10.1109/CVPR.2006.100;
[11] M. Tan and Q. V. Le, EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks, 2019.
[12] M. B. Pouyan, S. Ostadabbas, M. Farshbaf, R. Yousefi, M. Nourani and M. D. M. Pompeo, Continuous eight-posture classification for bed-bound patients, in Proc. BEI, 2013, pp. 121-126, https://doi.org/ 10.1109/BMEI.2013.67469.
[2] A. Zhao, J. Dong and H. Zhou, Self-supervised learning from multi-sensor data for sleep recognition, IEEE Access, vol. 8, pp. 93907-93921, 2020, https://doi.org/ 10.1109/ACCESS.2020.2994593;
[3] E. Yu, M. Kenji, Data augmentation to build high performance dnn for in-bed posture classification, Journal of Information Processing, vol. 26, pp. 718-727, 2018, https://doi.org/10.2197/ipsjjip.26.718;
[4] F. J. Costello et al., Exploring a fuzzy rule inferred convlstm for discovering and adjusting the optimal posture of patients with a smart medical bed, Int. J. Envi & Res. Pub Health, 2021, vol. 18, no. 12, pp. 1-14, https://doi.org/10.3390/ijerph1812634;
[5] V. Davoodnia and A. Etemad, Identity and posture recognition in smart beds with deep multitask learning, in Proc. SMC, 2019, pp. 3054-3059, https://doi.org/ 10.1109/SMC.2019.8914459;
[6] N. P. Doan, N. D. A. Pham, H. M. Pham, H. T. Nguyen, T. A. Nguyen and H. H. Nguyen, Real-time sleeping posture recognition for smart hospital beds, in Proc. MAPR, 2021, pp. 1-6, https://doi.org/ 10.1109/MAPR53640.2021.9585289;
[7] K. He, X. Zhang, S. Ren and J. Sun, Spatial pyramid pooling in deep convolutional networks for visual recognition, in Proc. ECCV, 2015, pp. 346-361, https://doi.org/10.1007/978-3-319-10578-9_23;
[8] H. H. Nguyen, T. N. Ta, N. C. Nguyen, V. T. Bui, H. M. Pham and D. M. Nguyen, YOLO based real-time human detection for smart video surveillance at the edge, in Proc. ICCE, 2021, pp. 439-444, https://doi.org/ 10.1109/ICCE48956.2021.9352144;
[9] H. P. Nguyen, T. P. Hoang and H. H. Nguyen, A deep learning based fracture detection in arm bone X-ray images, in Proc. MAPR, pp. 1-6, https://doi.org/ 10.1109/MAPR53640.2021.9585292;
[10] R. Hadsell, S. Chopra and Y. LeCun, Dimensionality reduction by learning an invariant mapping, in Proc. CVPR, 2006, pp. 1735-1742, https://doi.org/ 10.1109/CVPR.2006.100;
[11] M. Tan and Q. V. Le, EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks, 2019.
[12] M. B. Pouyan, S. Ostadabbas, M. Farshbaf, R. Yousefi, M. Nourani and M. D. M. Pompeo, Continuous eight-posture classification for bed-bound patients, in Proc. BEI, 2013, pp. 121-126, https://doi.org/ 10.1109/BMEI.2013.67469.