AUTHOR=Duan Weijun , Wang Fang , Li Honghui , Liu Na , Fu Xueliang 

TITLE=Lameness detection in dairy cows from overhead view: high-precision keypoint localization and multi-feature fusion classification

JOURNAL=Frontiers in Veterinary Science

VOLUME=Volume 12 - 2025

YEAR=2025

URL=https://www.frontiersin.org/journals/veterinary-science/articles/10.3389/fvets.2025.1675181

DOI=10.3389/fvets.2025.1675181

ISSN=2297-1769

ABSTRACT=IntroductionDetecting lameness in dairy cows from an overhead view can effectively avoid occlusion caused by farm facilities or other animals, while suspended detection devices enable parallel monitoring without disturbing natural behaviors. However, existing methods from this perspective still face challenges in accuracy and generalization, largely due to the subtlety of back movement features and individual variability. To address these limitations, this study explores an overhead-view lameness detection approach based on RGB-D data.MethodsWe developed a high-precision keypoint detection method for the cow’s back that models long-range spatial dependencies and optimizes structural representation. On this basis, six lameness-related features were designed to capture posture and motion abnormalities, including four newly proposed indices. Their correlation in classifying sound, mildly lame, and severely lame cows was systematically analyzed. To further enhance robustness, the Gini importance index from Random Forest combined with a permutation importance correction method (PIMP) was applied to construct an unbiased feature selection framework.ResultsExperimental results demonstrate that the proposed keypoint detection network achieved a PCK@0.02 of 100.00% and an average precision of 95.89%, significantly outperforming the baseline model. In feature-based classification, back curvature, movement asymmetry index, and vertical oscillations of the back and head exhibited strong discriminative ability. Using multi-feature fusion, the lameness detection model attained an overall accuracy of 91.00%.DiscussionThese findings indicate that overhead RGB-D imaging, combined with precise keypoint detection and feature fusion, provides a reliable strategy for accurate lameness detection in dairy cows. The proposed method offers valuable theoretical and technical support for health monitoring and intelligent management in modern dairy farming.