Abstract
Background: Self-supervised learning may improve segmentation when labelled data are limited, but its benefit may depend on model and initialisation strategy. This study evaluated in-domain masked-reconstruction pretraining across limited annotation budgets.
Methods: The International Skin Imaging Collaboration (ISIC) 2016 development set was partitioned into 765 images for self-supervised pretraining, 94 for fine-tuning and 41 for validation. Five nested annotation budgets (12-94 images) and five seeds were evaluated on the 379-image test set. A custom U-Net compared random and in-domain self-supervised initialisation; a ResNet-34 U-Net compared random, ImageNet, in-domain self-supervised and sequential ImageNet-to-self-supervised initialisation. Models trained with 94 labelled images were evaluated without adaptation on ISIC 2017. A separate experiment examined restoration-based pretraining.
Results: In the custom U-Net, self-supervised pretraining achieved higher mean Dice than random initialisation at all five budgets, including 0.664 versus 0.615 with 12 labels and 0.811 versus 0.768 with 94 labels. Seed-level 95% confidence intervals for paired differences excluded zero at 47 and 94 labels but not at the other budgets. With 47 labels, the self-supervised model achieved mean Dice of 0.789, compared with 0.768 for random initialisation with 94 labels. In ResNet-34, ImageNet initialisation achieved higher mean Dice than in-domain self-supervised pretraining at all five budgets, and adding self-supervised pretraining after ImageNet reduced mean Dice at four of five budgets. All six 94-label configurations achieved lower mean Dice on ISIC 2017 than ISIC 2016. In the restoration experiment, mean Dice was 0.686 with random initialisation and 0.638-0.642 following pretraining.
Conclusions: In-domain masked-reconstruction pretraining improved mean Dice relative to random initialisation in the custom U-Net, but not consistently in the ResNet-34 U-Net, where ImageNet initialisation performed better at every budget. Adding self-supervised pretraining after ImageNet provided no consistent gain. These findings are specific to the dermoscopic lesion-segmentation experiments and do not establish melanoma-specific diagnostic or clinical performance.