Action Quality Assessment Model Using Specialists’ Gaze Location and Kinematics Data—Focusing on Evaluating Figure Skating Jumps

Bibliographic Details
Title: Action Quality Assessment Model Using Specialists’ Gaze Location and Kinematics Data—Focusing on Evaluating Figure Skating Jumps
Authors: Seiji Hirosawa, Takaaki Kato, Takayoshi Yamashita, Yoshimitsu Aoki
Source: Sensors, Vol 23, Iss 22, p 9282 (2023)
Publisher Information: MDPI AG, 2023.
Publication Year: 2023
Collection: LCC:Chemical technology
Subject Terms: computer vision application, human action evaluation, sports activity scoring, double-axel jump, grade of execution score, sports officials, Chemical technology, TP1-1185
More Details: Action quality assessment (AQA) tasks in computer vision evaluate action quality in videos, and they can be applied to sports for performance evaluation. A typical example of AQA is predicting the final score from a video that captures an entire figure skating program. However, no previous studies have predicted individual jump scores, which are of great interest to competitors because of the high weight of competition. Despite the presence of unnecessary information in figure skating videos, human specialists can focus and reduce information when they evaluate jumps. In this study, we clarified the eye movements of figure skating judges and skaters while evaluating jumps and proposed a prediction model for jump performance that utilized specialists’ gaze location to reduce information. Kinematic features obtained from the tracking system were input into the model in addition to videos to improve accuracy. The results showed that skaters focused more on the face, whereas judges focused on the lower extremities. These gaze locations were applied to the model, which demonstrated the highest accuracy when utilizing both specialists’ gaze locations. The model outperformed human predictions and the baseline model (RMSE:0.775), suggesting a combination of human specialist knowledge and machine capabilities could yield higher accuracy.
Document Type: article
File Description: electronic resource
Language: English
ISSN: 1424-8220
Relation: https://www.mdpi.com/1424-8220/23/22/9282; https://doaj.org/toc/1424-8220
DOI: 10.3390/s23229282
Access URL: https://doaj.org/article/694fe2e12d324bcfb2720b167e119489
Accession Number: edsdoj.694fe2e12d324bcfb2720b167e119489
Database: Directory of Open Access Journals
Full text is not displayed to guests.
More Details
ISSN:14248220
DOI:10.3390/s23229282
Published in:Sensors
Language:English