Binary Classifier

• Observed response y takes only two possible values + and -

• Define relationship between $h(x)$ and $y$

• If larger than the threshold, then set to 1, if less, then set to 0

• Use the decision rule:

$$\hat{y}=\left\{\begin{array}{ll} {+,} & {h(x) \geq t} \\ {-,} & {\text { otherwise }} \end{array}\right.$$