Skip to main navigation Skip to search Skip to main content

Self-pu: Self boosted and calibrated positive-unlabeled training

  • Xuxi Chen
  • , Wuyang Chen
  • , Tianlong Chen
  • , Ye Yuan
  • , Chen Gong
  • , Kewei Chen
  • , Zhangyang Wang

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Many real-world applications have to tackle the Positive-Unlabeled (PU) learning problem, i.e., learning binary classifiers from a large amount of unlabeled data and a few labeled positive examples. While current state-of-the-art methods employ importance reweighting to design various risk estimators, they ignored the learning capability of the model itself, which could have provided reliable supervision. This motivates us to propose a novel Self-PU1 learning framework, which seamlessly integrates PU learning and self-training. Self-PU highlights three "self"- oriented building blocks: A self-paced training algorithm that adaptively discovers and augments confident positive/negative examples as the training proceeds; a self-calibrated instance-aware loss; and a self-distillation scheme that introduces teacher-students learning as an effective regularization for PU learning. We demonstrate the state-of-the-art performance of Self-PU on common PU learning benchmarks (MNIST and CIFAR-10), which compare favorably against the latest competitors. Moreover, we study a realworld application of PU learning, i.e., classifying brain images of Alzheimer's Disease. Self- PU obtains significantly improved results on the renowned Alzheimer's Disease Neuroimaging Initiative (ADNI) database over existing methods.

Original languageEnglish (US)
Title of host publication37th International Conference on Machine Learning, ICML 2020
EditorsHal Daume, Aarti Singh
PublisherInternational Machine Learning Society (IMLS)
Pages1487-1497
Number of pages11
ISBN (Electronic)9781713821120
StatePublished - 2020
Externally publishedYes
Event37th International Conference on Machine Learning, ICML 2020 - Virtual, Online
Duration: Jul 13 2020 → Jul 18 2020

Publication series

Name37th International Conference on Machine Learning, ICML 2020
VolumePartF168147-2

Conference

Conference37th International Conference on Machine Learning, ICML 2020
CityVirtual, Online
Period7/13/20 → 7/18/20

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Human-Computer Interaction
  • Software

Fingerprint

Dive into the research topics of 'Self-pu: Self boosted and calibrated positive-unlabeled training'. Together they form a unique fingerprint.

Cite this