3-D Human Pose Estimation by Convolutional Neural Network in the Video Traditional Martial Arts Presentation

Tuong-Thanh Nguyen1, , Van-Hung Le2, Thanh-Cong Pham1
1 Hanoi University of Science and Technology, No. 1, Dai Co Viet, Hai Ba Trung, Hanoi, Viet Nam
2 Tan Trao University, Km6, Trung Mon, Yen Son, Tuyen Quang, Viet Nam

Main Article Content

Abstract

Preservation and maintenance of traditional martial arts and teaching martial arts are very important activities in social life. It helps preserving national culture, train health, and self-defense for people. However, traditional martial arts have many different postures and activities of the body and body parts. In this paper, we are proposed using deep learning with Convolutional Neural Network (CNN) for estimating key points and joints of actions in traditional martial arts postures and proposed the evaluation methods. The training set has been learned on the 2016 MSCOCO keypoints challenge classic database, the results are evaluated on 14 videos of traditional martial art performances with complicated postures. The estimated results are high and published. In particular, we present the results of estimating key points and joints in 3-D space to support the construction of a traditional martial arts conservation and teaching application.

Article Details

References

[1] Rantz, M., Banerjee, T., Cattoor, E., Scott, S., Skubic, M., & Popescu, M.; Automated fall detection with quality improvement ''rewind'' to reduce falls in hospital rooms; J Gerontol Nurs, 40(1), 13-17, 2014.
[2] Miguel, K. d., Brunete, A., Hernando, M., & Gamboa, E.; Home CameraBased Fall Detection System for the Elderly; Journal of Sensors, 17(12), (2017).
[3] Ahmed, M., Mehmood, N., Adnan, N., Mehmood, A., & Rizwan, K.; Fall Detection System for the Elderly Based on the Classification of Shimmer Sensor Prototype Data. Healthc Inform Res, 23(3), 147-158, 2017.
[4] IgualCarlos, R., Carlos, M., & Plaza, I.; Challenges, Issues and Trends in Fall Detection Systems. BioMedical Engineering OnLine, 12(1), 147-158, 2013.
[5] Dinh, T. B. Bao ton va phat huy vo co truyen Binh dinh: Tiep tuc ho tro cao co duong tieu bieu. http://www.baobinhdinh.com.vn/viewer.aspx?macm=12&macmp=12&mbabb=88043.
[6] Dinh, T. B. Ai ve Binh Dinh ma coi, Con gai Binh Dinh bo roi di quyen. http://www.seagullhotel.com.vn/du-lich-binh-dinh/vo-co-truyen-binh-dinh-5.
[7] Chinese Kung Fu (Martial Arts). https://www.travelchinaguide.com/intro/martial_arts/.
[8] ECCV2018. ECCV 2018 Joint COCO and Mapillary Recognition). http://cocoatdataset.org/#home.
[9] 2017, MSCOCO Keypoints Challenge 2017. https://places-coco2017.github.io/.
[10] Dinh, T. B. (2011). Preserving traditional martial arts). http://www.baobinhdinh.com.vn/ culture-kungfu-hotel.com/.
[11] Chinese (2012). Traditional Chinese martial arts and the transmission of intangible cultural heritage). https://www.academia.edu/18641528/Fighting_mode _tradiional_Chinese_martial_arts_and_the_trans mission_of_intangible_cultural_heritage.
[12] Microsoft. Kinect for Windows SDK v1.8. https://www.microsoft.com/en us/download/details.aspx?id= 40278.
[13] OpenCV library. https://opencv.org/.
[14] MICA. International Research Institute MICA. http://mica.edu.vn./
[15] Openpose. http://www.cse.cuhk.edu.hk/~choyz/openpose-Lab/.