# Choosing a line/plane to separate two classes of binned data

In high energy physics I know it is common task to find the best separation point between two classes of data, usually signal and noise. This separation point is usually determined by first binning the data, then making a decision based on maximizing the amount of signal while minimizing the amount of noise present on one side of the cut. For example, in the image below, blue might be signal, and red might be noise. You may hope for to set a cut that you'll expect in the future will have 70% signal on one side, and 30% noise. You may wish instead to get nearly all the signal, despite a large amount of noise. Then you'll set a cut that gets, say, 95% of the signal, but 60% of the noise.

It is important not to make a parametric assumption about the distribution that both the signal and the noise are considered samples from.

How does this procedure generalize to $N$ dimensions? How would a statistician approach this problem? Is there a principled or named way of doing so?

Below is an image I found on the web that depicts a one dimensional example of this scenario. One might choose to separate the red and blue data (make a cut) possibly at 0.1, or perhaps at 0.4. Maybe ignore the bit of blue showing in the 0.8 - 0.9 bin for this example!

• Could you tell us what this separation point is supposed to mean? How would it be interpreted or used in further data analysis? – whuber Mar 2 '15 at 20:56
• It is to separate noise and signal. Say blue is signal, red is noise. Edited question – bill_e Mar 2 '15 at 21:01
• It is difficult to conceive of red as "noise" in this example: it looks like another signal. In a spectrograph like this people are typically interested in (a) quantifying the area under each separate peak, (b) determining whether a peak can be distinguished from a neighboring peak or underlying noise (of which there is very little apparent in this example), or (c) identifying a threshold used to discriminate one signal from the other (such as blue vs. red). Only the latter actually needs a "separation point" to be identified. That's why I am inquiring as to your objectives. – whuber Mar 2 '15 at 21:04
• (C) is exactly what I am asking about. – bill_e Mar 2 '15 at 21:07