Time Series Classification of Badminton Pose using LSTM with Landmark Tracking
Abstract
Traditional methods of analyzing badminton matches, such as video movement analysis, are time-consuming, prone to errors, and rely heavily on manual annotation. This creates challenges in accurately and efficiently classifying badminton actions and player poses. This paper aims to develop an accurate time series classification method for badminton poses using landmark tracking. The proposed method integrates Long Short-Term Memory (LSTM) networks with landmark tracking to classify badminton poses in a time series, addressing the limitations of traditional video analysis techniques. The dataset consists of 30 respondents performing three distinct activities—lob, smash, and serve—under two conditions: good and bad execution. The approach combines LSTM networks with landmark tracking data, utilizing intra-class variation from a multi-view dataset to enhance pose classification accuracy. The LSTM model achieved high accuracy in classifying badminton poses, successfully detecting serves, lobs, and smashes in real-time with over 90% accuracy. Additionally, the system improved match analysis, achieving 85% accuracy in detection and classification, demonstrating the effectiveness of combining landmark tracking with machine learning for sports analysis. This study underscores the importance of pose estimation in badminton analysis, particularly through landmark tracking, which significantly improves the accuracy of classifying player poses and contributes to the advancement of automated sports analysis.
Downloads
References
Z. Xipeng, Z. Peng, and C. Yecheng, “Research on Badminton Teaching Technology Based on Human Pose Estimation Algorithm,” Sci. Program., vol. 2022, 2022, doi: 10.1155/2022/4664388.
C. Cuiping, “Badminton Video Analysis Based on Player Tracking and Pose Trajectory Estimation,” Proc. - 2021 13th Int. Conf. Meas. Technol. Mechatronics Autom. ICMTMA 2021, pp. 471–474, 2021, doi: 10.1109/ICMTMA52658.2021.00108.
C. K. Ingwersen, C. Møller Mikkelstrup, J. N. Jensen, M. Rieger Hannemose, and A. B. Dahl, “SportsPose - A Dynamic 3D sports pose dataset,” IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Work., vol. 2023-June, pp. 5219–5228, 2023, doi: 10.1109/CVPRW59228.2023.00550.
S. S. Yue, R. Paramesran, and G. Krishnasamy, “Ready-to-Serve Detection in Badminton Videos,” 2024, doi: 10.1109/ICEIC61013.2024.10457177.
P. Huang, L. Fu, Y. Zhang, G. Fekete, F. Ren, and Y. Gu, “Biomechanical analysis methods to assess professional badminton players’ lunge performance,” J. Vis. Exp., vol. 2019, no. 148, Jun. 2019, doi: 10.3791/58842.
Z. Cao, G. Hidalgo, T. Simon, S.-E. Wei, and Y. Sheikh, “OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 43, no. 1, pp. 172--186, Dec. 2019, [Online]. Available: http://arxiv.org/abs/1812.08008.
A. Bearman and C. Dong, “Human Pose Estimation and Activity Classification Using Convolutional Neural Networks,” Stanford CS231n, 2015.
Y. Luo et al., “LSTM Pose Machines,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 5207–5215, 2018, doi: 10.1109/CVPR.2018.00546.
S. Krizkova, H. Tomaskova, and E. B. Tirkolaee, “Sport performance analysis with a focus on racket sports: A review,” Appl. Sci., vol. 11, no. 19, Oct. 2021, doi: 10.3390/app11199212.
Z. Liang and T. E. Nyamasvisva, “Badminton Action Classification Based on Human Skeleton Data Extracted by AlphaPose,” in 2023 International Conference on Sensing, Measurement & Data Analytics in the era of Artificial Intelligence (ICSMD), Nov. 2023, pp. 1–4, doi: 10.1109/ICSMD60522.2023.10490491.
X.-W. Zhou, L. Ruan, S.-S. Yu, J. Lai, Z.-F. LI, and W.-T. Chen, “Badminton Action Classification Based on PDDRNet,” in Proceedings of the 3rd International Conference on Internet, Education and Information Technology (IEIT 2023, 2023, pp. 980–987, doi: 10.2991/978-94-6463-230-9_118.
L. I. Yunwei and J. Shiwei, “Video Analysis Technology and Its Application in Badminton Sports Training,” in Journal of Physics: Conference Series, Jun. 2019, vol. 1213, no. 2, doi: 10.1088/1742-6596/1213/2/022009.
Y. Nokihara, R. Hachiuma, R. Hori, and H. Saito, “Future Prediction of Shuttlecock Trajectory in Badminton Using Player’s Information,” J. Imaging, vol. 9, no. 5, 2023, doi: 10.3390/jimaging9050099.
M. A. Haq and N. Tagawa, “Improving Badminton Player Detection using YOLOv3 with Various Training Heuristics,” Int. J. INFORMATICS Vis., vol. 7, no. 2, pp. 548–554, 2023, [Online]. Available: www.joiv.org/index.php/joiv.
M. A. Sarwar, Y. C. Lin, Y. A. Daraghmi, T. U. Ik, and Y. L. Li, “Skeleton Based Keyframe Detection Framework for Sports Action Analysis: Badminton Smash Case,” IEEE Access, vol. 4, 2023, doi: 10.1109/ACCESS.2023.3307620.
Y. K. Cheng and J. J. Kim, “AI-powered Badminton Video Detection: Enhancing Gameplay Analysis and Training,” J Robot Auto Res, vol. 4, no. 2, pp. 392–402, 2023.
O. Dieu, C. Schnitzler, C. Llena, and F. Potdevin, “Complementing subjective with objective data in analysing expertise: A machine-learning approach applied to badminton,” Jour-nal Sport. Sci., vol. 2020, no. 17, 2020, doi: 10.1080/02640414.2020.1764812ï.
X. Cui, W. K. Lam, Q. Gao, X. Wang, and T. Zhao, “Biomechanical Analysis on Skilled Badminton Players during Take-Off Phase in Forehand Overhead Strokes: A Pilot Study,” Biology (Basel)., vol. 11, no. 10, Oct. 2022, doi: 10.3390/biology11101401.
R. Miller, H. Towler, S. Mcerlain-Naylor, and M. King, “Relationships between whole-body kinematics and badminton jump smash racket head speed,” ISBS Proc. Arch., vol. 38, no. 1, p. 480, 2020, [Online]. Available: https://commons.nmu.edu/isbs.
F. Ashfaq, N. Z. Jhanjhi, and N. A. Khan, “Badminton Player’s Shot Prediction Using Deep Learning,” in Lecture Notes in Bioengineering, 2023, pp. 233–243, doi: 10.1007/978-981-99-0297-2_19.
J. Liu and B. Liang, “An Action Recognition Technology for Badminton Players Using Deep Learning,” Mob. Inf. Syst., vol. 2022, 2022, doi: 10.1155/2022/3413584.
W. Y. Wang, T. F. Chan, W. C. Peng, H. K. Yang, C. C. Wang, and Y. C. Fan, “How Is the Stroke? Inferring Shot Influence in Badminton Matches via Long Short-term Dependencies,” ACM Trans. Intell. Syst. Technol., vol. 14, no. 1, Nov. 2022, doi: 10.1145/3551391.
W. Y. Wang, T. F. Chan, H. K. Yang, C. C. Wang, Y. C. Fan, and W. C. Peng, “Exploring the Long Short-Term Dependencies to Infer Shot Influence in Badminton Matches,” Proc. - IEEE Int. Conf. Data Mining, ICDM, vol. 2021-Decem, pp. 1397–1402, 2021, doi: 10.1109/ICDM51629.2021.00178.
A. Malik and R. Jain, “Badminton Action Analysis Using LSTM,” Int. Conf. Appl. Intell. Sustain. Comput. ICAISC 2023, pp. 3–8, 2023, doi: 10.1109/ICAISC58445.2023.10201000.
J. Deng, S. Zhang, and J. Ma, “Self-Attention-Based Deep Convolution LSTM Framework for Sensor-Based Badminton Activity Recognition,” Sensors (Basel)., vol. 23, no. 20, Oct. 2023, doi: 10.3390/s23208373.
N. A. Rahmad, M. A. As’Ari, K. Soeed, and I. Zulkapri, “Automated badminton smash recognition using convolutional neural network on the vision based data,” IOP Conf. Ser. Mater. Sci. Eng., vol. 884, no. 1, 2020, doi: 10.1088/1757-899X/884/1/012009.
Fazle Karim and Somshubra Majumdar and Houshang Darabi and Samuel Harford, “Multivariate LSTM-FCNs for time series classification,” Neural networks., vol. 116, pp. 237-245, 2019, doi: 10.1016/j.neunet.2019.04.014.
Haobo Li, and Aman Shrestha, and Hadi Heidari, and, Julien Le Kernec and Francesco Fioranelli, “Bi-LSTM network for multimodal continuous human activity recognition and fall detection,” IEEE Sensors Journal., vol. 20, no 3, 2019, doi: 10.1109/JSEN.2019.2946095.
S. Simske, Meta-analytics: consensus approaches and system patterns for data analysis. Morgan Kaufmann, 2019.
Jianfeng Xu and Yuanjian Zhang and Duoqian Miao, “Three-way confusion matrix for classification: A measure driven view,” Information sciences., vol. 507, pp. 772-794, 2020, doi: 10.1016/j.ins.2019.06.064.
Tukino, Tukino, Mutiana Pratiwi, & Sarjon Defit. "Deep Learning Based Technical Classification of Badminton Pose with Convolutional Neural Networks." ILKOM Jurnal Ilmiah [Online], vol. 16, No.1, pp. 76-86, 2024. doi: :https://doi.org/10.33096/ilkom.v16i1.1951.76-86
Copyright (c) 2024 BEDY PURNAMA, Bayu Erfianto, Ilo Raditio Wirawan
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlikel 4.0 International (CC BY-SA 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
