Automatic body part and pose detection in medical infrared thermal images


Özdil A., YILMAZ B.

Quantitative InfraRed Thermography Journal, cilt.19, sa.4, ss.223-238, 2022 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 19 Sayı: 4
  • Basım Tarihi: 2022
  • Doi Numarası: 10.1080/17686733.2021.1947595
  • Dergi Adı: Quantitative InfraRed Thermography Journal
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Compendex, INSPEC
  • Sayfa Sayıları: ss.223-238
  • Anahtar Kelimeler: Medical infrared thermal imaging, pose detection, computer-aided medical diagnosis, THERMOGRAPHY
  • Kayseri Üniversitesi Adresli: Hayır

Özet

© 2021 Informa UK Limited, trading as Taylor & Francis Group.Automatisation and standardisation of the diagnosis process in medical infrared thermal imaging (MITI) is crucial because the number of medical experts in this area is highly limited.The current studies generally need manual intervention. One of the manual operations requires physician’s determination of the body part and orientation. In this study automatic pose and body part detection on medical thermal images is investigated. The database (957 thermal images - 59 patients) was divided into four classes upper-lower body parts with back-front views. First, histogram equalization (HE) method was applied on the pixels only within the body determined using Otsu’sthresholding approach. Secondly, DarkNet-19 architecture was used for feature extraction, and principal component analysis (PCA) and t-distributed stochastic neighbour embedding (t-SNE) approaches for feature selection. Finally, the performances of various machine learning based classification methods were examined. Upper vs. lower body parts and back vs. front of upper body were classified with 100% accuracy, and back vs. front classification of lower body part success rate was 93.38%. This approach will improve the automatisation process of thermal images to group them for comparing one image with the others and to perform queries on the labeled images in a more user-friendly manner.