Online training for body part segmentation in infant movement videos

Qian Zhang, Yuan Xue, Xiaolei Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations


In this paper, we investigate methods based on Convolutional Neural Networks (CNN) and online learning for infant body part segmentation in videos. Long videos of infant movement can be used to detect abnormal neurological development caused by various reasons. In order to perform movement analysis and assist with diagnosis, it is crucial to accurately segment infant body parts in videos. Existing CNN based segmentation methods can perform reasonably well given sufficient training data, but cannot reach an accuracy level that is needed for clinical use. We propose and experimentally validate three methods that significantly improve segmentation accuracy and efficiency: (1) content-dependent training sample selection reduces the amount of training data needed while boosts segmentation accuracy, (2) a weighted loss function with different weights for different body parts is shown to both improve accuracy and reduce computation time, (3) online learning by dynamically augmenting the training set with a small number of sample frames from new videos significantly improves testing accuracy on the new videos. Our experiments are conducted on infant movement videos that exhibit large variations in object pose, shape, appearance, background and camera viewpoints. Both qualitative segmentation results and quantitative comparisons demonstrate the superiority and efficiency of our proposed approach.

Original languageEnglish (US)
Title of host publicationISBI 2019 - 2019 IEEE International Symposium on Biomedical Imaging
PublisherIEEE Computer Society
Number of pages4
ISBN (Electronic)9781538636411
StatePublished - Apr 2019
Event16th IEEE International Symposium on Biomedical Imaging, ISBI 2019 - Venice, Italy
Duration: Apr 8 2019Apr 11 2019

Publication series

NameProceedings - International Symposium on Biomedical Imaging
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452


Conference16th IEEE International Symposium on Biomedical Imaging, ISBI 2019

All Science Journal Classification (ASJC) codes

  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging


Dive into the research topics of 'Online training for body part segmentation in infant movement videos'. Together they form a unique fingerprint.

Cite this