Improving deep facial phenotyping for ultra-rare disorder verification using model ensembles

Published in 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023

Recommended citation: Hustinx, Alexander et al. "Improving deep facial phenotyping for ultra-rare disorder verification using model ensembles." 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). IEEE, 2023 https://ieeexplore.ieee.org/abstract/document/10030218/

Rare genetic disorders affect more than 6% of the global population. Reaching a diagnosis is challenging because rare disorders are very diverse. Many disorders have recognizable facial features that are hints for clinicians to diagnose patients. Previous work, such as GestaltMatcher, utilized representation vectors produced by a DCNN similar to AlexNet to match patients in high-dimensional feature space to support "unseen" ultra-rare disorders. However, the architecture and dataset used for transfer learning in GestaltMatcher have become outdated. Moreover, a way to train the model for generating better representation vectors for unseen ultra-rare disorders has not yet been studied. Because of the overall scarcity of patients with ultra-rare disorders, it is infeasible to directly train a model on them. Therefore, we first analyzed the influence of replacing GestaltMatcher DCNN with a state-of-the-art face recognition …