Learning from positive and unlabeled examples -Finite size sample bounds

Farnam Mansouri (University of Waterloo) · Shai Ben-David (Universitys of Waterloo)
class priorclassification tasksdata generating distributionlearning algorithmslower boundsmodel evaluationpositive unlabeled learningpositively labeled instancessample sizessimplifying assumptionsstatistical complexitysupervised classificationtheoretical analysisunlabeled samplesupper bounds

PU (Positive Unlabeled) learning is a variant of supervised classification learning in which the only labels revealed to the learner are of positively labeled instances. PU learning arises in many real-world applications. Most existing work relies on the simplifying assumption that the positively labeled training data is drawn from the restriction of the data generating distribution to positively labeled instances and/or that the proportion of positively labeled points (a.k.a. the class prior) is known apriori to the learner. This paper provides a theoretical analysis of the statistical complexity of PU learning under a wider range of setups. Unlike most prior work, our study does not assume that the class prior is known to the learner. We prove upper and lower bounds on the required sample sizes (of both the positively labeled and the unlabeled samples).