name of this problem?

I'm sure this sort of problem has been addressed, but I'm having
trouble finding anything on it since I don't know what it's called.
(I've been calling it a discrimination problem...)

Say, for example, you are trying to determine which of 2 options, x and
y, is the best (has the highest value of some quanity) . You can noisy
measurements for each option, but you are allowed only a limited number
of measurements and must decide how to use them (i.e. how many times
are you will sample x and how many times you will sample y). The
objective is to maximize the probability that the option whose
measurements have the higher mean is actually the one with the higher
value.

If you only have 2 options with zero-mean guassian noise on the
measurements, then it's not hard to show that you should sample each
option in relative proportion to the standard deviation of the noise
for the option. However, I'm more interested in the multiple option
case and using the only the sample variance instead of the true value.

.

Relevant Pages

  • Re: name of this problem?
    ... > trouble finding anything on it since I don't know what it's called. ... > limited number of measurements and must decide how to use them (i.e. ... > If you only have 2 options with zero-mean guassian noise on the ... could try "sequential decision making". ...
    (sci.stat.math)
  • Re: Precision issue of CreateTimerQueueTimer()
    ... KeQueryPerformanceCounter() call in the kernel mode. ... computing performance and capacity measurements. ... Consequently, calling this routine frequently, ... Therefore, if you intend ...
    (microsoft.public.win32.programmer.kernel)
  • Re: OT:Thanksgiving
    ... go back in time to take the measurements for himself and prove the GW ... but is founded in observable fact and not in ignorance or scepticism. ... waves lapping around my feet on the beach (currently 200 feet above ... Calling you a worshipper of a minor Midianite ...
    (comp.lang.cobol)