TY - GEN
T1 - Self-pu
T2 - 37th International Conference on Machine Learning, ICML 2020
AU - Chen, Xuxi
AU - Chen, Wuyang
AU - Chen, Tianlong
AU - Yuan, Ye
AU - Gong, Chen
AU - Chen, Kewei
AU - Wang, Zhangyang
N1 - Publisher Copyright: © 2020 37th International Conference on Machine Learning, ICML 2020. All rights reserved.
PY - 2020
Y1 - 2020
N2 - Many real-world applications have to tackle the Positive-Unlabeled (PU) learning problem, i.e., learning binary classifiers from a large amount of unlabeled data and a few labeled positive examples. While current state-of-the-art methods employ importance reweighting to design various risk estimators, they ignored the learning capability of the model itself, which could have provided reliable supervision. This motivates us to propose a novel Self-PU1 learning framework, which seamlessly integrates PU learning and self-training. Self-PU highlights three "self"- oriented building blocks: A self-paced training algorithm that adaptively discovers and augments confident positive/negative examples as the training proceeds; a self-calibrated instance-aware loss; and a self-distillation scheme that introduces teacher-students learning as an effective regularization for PU learning. We demonstrate the state-of-the-art performance of Self-PU on common PU learning benchmarks (MNIST and CIFAR-10), which compare favorably against the latest competitors. Moreover, we study a realworld application of PU learning, i.e., classifying brain images of Alzheimer's Disease. Self- PU obtains significantly improved results on the renowned Alzheimer's Disease Neuroimaging Initiative (ADNI) database over existing methods.
AB - Many real-world applications have to tackle the Positive-Unlabeled (PU) learning problem, i.e., learning binary classifiers from a large amount of unlabeled data and a few labeled positive examples. While current state-of-the-art methods employ importance reweighting to design various risk estimators, they ignored the learning capability of the model itself, which could have provided reliable supervision. This motivates us to propose a novel Self-PU1 learning framework, which seamlessly integrates PU learning and self-training. Self-PU highlights three "self"- oriented building blocks: A self-paced training algorithm that adaptively discovers and augments confident positive/negative examples as the training proceeds; a self-calibrated instance-aware loss; and a self-distillation scheme that introduces teacher-students learning as an effective regularization for PU learning. We demonstrate the state-of-the-art performance of Self-PU on common PU learning benchmarks (MNIST and CIFAR-10), which compare favorably against the latest competitors. Moreover, we study a realworld application of PU learning, i.e., classifying brain images of Alzheimer's Disease. Self- PU obtains significantly improved results on the renowned Alzheimer's Disease Neuroimaging Initiative (ADNI) database over existing methods.
UR - https://www.scopus.com/pages/publications/85105142113
UR - https://www.scopus.com/pages/publications/85105142113#tab=citedBy
M3 - Conference contribution
T3 - 37th International Conference on Machine Learning, ICML 2020
SP - 1487
EP - 1497
BT - 37th International Conference on Machine Learning, ICML 2020
A2 - Daume, Hal
A2 - Singh, Aarti
PB - International Machine Learning Society (IMLS)
Y2 - 13 July 2020 through 18 July 2020
ER -