Application of Ensemble Learning and Feature Selection Models in Energy Expenditure Estimation of Fitness Tracking Devices
The use of fitness tracking devices to monitor energy expenditure (EE) is becoming increasingly popular among consumers. However, the accuracy of EE estimation still needs to be improved due to the lack of accurate data filtering and more efficient data analysis models. To address this issue, we designed an energy expenditure estimation (EEE) model based on smart tracking devices. This paper proposes an algorithm for data reconstruction called PC-DF-RFECV: firstly, Pearson correlation analysis (PC) is used for initial data screening, then Feature Derivation (DF) is applied to reconstruct new features, and finally, the Recursive Feature Elimination algorithm based on cross-validation (RFECV) is employed to select the new features. Furthermore, the EEE model adopts a weighted average (Wei-Voting) strategy to enhance the robustness of the model by integrating the predictions of multiple base learners (XGBoost, LightGBM, Random Forest). During algorithm optimization, a Bayesian hyperparameter optimization technique is employed to fine-tune the model's hyperparameters. Empirical findings indicate that the EEE model, when applied to the dataset collected from motion tracking devices, attains an score of 0.9985, of 1.033, and of 0.865. These results demonstrate superior performance compared to current state-of-the-art research and conventional algorithms including random forests, gradient boosting, and bagging.
References
- Parrilla, M.; De Wael, K. Wearable self‐powered electrochemical devices for continuous health management. Advanced Functional Materials 2021, 31, 2107042. https://doi.org/10.1002/adfm.202107042
- Huifeng, W.; Kadry, S.N.; Raj, E.D. Continuous health monitoring of sportsperson using IoT devices based wearable technology. Computer Communications 2020, 160, 588-595. https://doi.org/10.1016/j.comcom.2020.04.025
- Tarafdar, P.; Bose, I. Recognition of human activities for wellness management using a smartphone and a smartwatch: a boosting approach. Decision Support Systems 2021, 140, 113426. https://doi.org/10.1016/j.dss.2020.113426
- Shin, J.C.; Kim, J.; Grigsby-Toussaint, D. Mobile phone interventions for sleep disorders and sleep quality: systematic review. JMIR mHealth and uHealth 2017, 5, e7244. https://doi.org/10.1016/j.jad.2022.02.008
- Oyelade, T.; Canciani, G.; Carbone, G.; Alqahtani, J.S.; Moore, K.; Mani, A.R. Heart rate variability in patients with cirrhosis: a systematic review and meta-analysis. Physiological Measurement 2021, 42, 055003. DOI 10.1088/1361-6579/abf888
- Chowdhury, E.A.; Western, M.J.; Nightingale, T.E.; Peacock, O.J.; Thompson, D. Assessment of laboratory and daily energy expenditure estimates from consumer multi-sensor physical activity monitors. PloS one 2017, 12, e0171720. https://doi.org/10.1371/journal.pone.0171720
- Dooley, E.E.; Golaszewski, N.M.; Bartholomew, J.B. Estimating accuracy at exercise intensities: a comparative study of self-monitoring heart rate and physical activity wearable devices. JMIR mHealth and uHealth 2017, 5, e7043. doi:10.2196/mhealth.7043
- Wang, Y.; Cang, S.; Yu, H. A survey on wearable sensor modality centred human activity recognition in health care. Expert Systems with Applications 2019, 137, 167-190. https://doi.org/10.1016/j.eswa.2019.04.057
- Guo, J.; Yang, L.; Bie, R.; Yu, J.; Gao, Y.; Shen, Y.; Kos, A. An XGBoost-based physical fitness evaluation model using advanced feature selection and Bayesian hyper-parameter optimization for wearable running monitoring. Computer Networks 2019, 151, 166-180. https://doi.org/10.1016/j.comnet.2019.01.026
- Sattar, S.; Li, S.; Chapman, M. Road surface monitoring using smartphone sensors: A review. Sensors 2018, 18, 3845. https://doi.org/10.3390/s18113845
- Yuan, Y.; Shen, Q.; Wang, S.; Ren, J.; Yang, D.; Yang, Q.; Fan, J.; Mu, X. Coronavirus mask protection algorithm: A new bio-inspired optimization algorithm and its applications. Journal of Bionic Engineering 2023, 1-19.
- Yang, D.-H.; Lee, H.-J.; Lim, D.-J. RolexBoost: A Rotation-Based Boosting Algorithm With Adaptive Loss Functions. IEEE Access 2020, 8, 41037-41044. DOI: 10.1109/ACCESS.2020.2976822
- Ren, J.; Wang, Z.; Pang, Y.; Yuan, Y. Genetic algorithm-assisted an improved AdaBoost double-layer for oil temperature prediction of TBM. Advanced Engineering Informatics 2022, 52, 101563. https://doi.org/10.1016/j.aei.2022.101563
- Zhou, Z.-H.; Wu, J.; Tang, W. Ensembling neural networks: many could be better than all. Artificial intelligence 2002, 137, 239-263. https://doi.org/10.1016/S0004-3702(02)00190-X
- Kim, H.; Kim, H.; Moon, H.; Ahn, H. A weight-adjusted voting algorithm for ensembles of classifiers. Journal of the Korean Statistical Society 2011, 40, 437-449. https://doi.org/10.1016/j.jkss.2011.03.002
- van den Heuvel, E.; Zhan, Z. Myths about linear and monotonic associations: Pearson’sr, Spearman’s ρ, and Kendall’s τ. The American Statistician 2022, 76, 44-52. https://doi.org/10.1080/00031305.2021.2004922
- Chen, T.; He, T.; Benesty, M.; Khotilovich, V.; Tang, Y.; Cho, H.; Chen, K.; Mitchell, R.; Cano, I.; Zhou, T. Xgboost: extreme gradient boosting. R package version 0.4-2 2015, 1, 1-4.
- Ke, G.; Meng, Q.; Finley, T.; Wang, T.; Chen, W.; Ma, W.; Ye, Q.; Liu, T.-Y. Lightgbm: A highly efficient gradient boosting decision tree. Advances in neural information processing systems 2017, 30.
- Lin, C.-W.; Yang, Y.-T.C.; Wang, J.-S.; Yang, Y.-C. A wearable sensor module with a neural-network-based activity classification algorithm for daily energy expenditure estimation. IEEE Transactions on Information Technology in Biomedicine 2012, 16, 991-998. 10.1109/TITB.2012.2206602
- Hibbert, J.M.; Broemeling, L.D.; Isenberg, J.N.; Wove, R.R. Determinants of Free‐Living Energy Expenditure in Normal Weight and Obese Women Measured by Doubly Labeled Water. Obesity research 1994, 2, 44-53. https://doi.org/10.1002/j.1550-8528.1994.tb00043.x