Re: Probability vs. Confidence Levels



suarez_k@xxxxxxxxxxx wrote in news:1171988696.738901.216950
@k78g2000cwa.googlegroups.com:

I'm looking at the work that a coworker is working on and I want to
see if someone can help me to understand where he went wrong or where
I want wrong in understanding.

Situation: He wants to determine what the confidence level is for
detecting faults inserted into a circuit card. He uses the
probability formula, but ties it to a confidence level.

I get the sense that ideas regarding confidence levels and ideas
regarding the statistical power of tests are being confused. The
confidence level is the probability that an interval (for example 1.96
sample std deviations around a sample mean) includes the unknown
population parameter (say the population mean) of interest. That may be
the "constant" you are referring to below.

For example: The current process calculates the percent detection as
being equal to the percentage of sampled faults that were
detected( e.g. - if 18 of 20 faults inserted were detected the percent
detection would be 18/20=.90 or 90%)

In reality, a program that detects 18 of 20 sampled faults has only a
32.3% probability (confidence level) of 90% fault detection. He used
the probability formula to get this number)

The power of a test (equal to one minus the probability of incorrectly
accepting the null hypothesis when it isn't true) is the probability that
the null hypothesis will be rejected when the population parameter is
different than hypothesized. Say you want to know mu= true proportion of
errors. Power increases with larger samples and with greater difference
between the H0 value of mu (say 0.9) and the true value of mu. You are
not going to have very much power to detect a difference of 0.1 with a
sample size of 20.

From what I understand, which isn't much, probability involves random
variables and confidence refers to a constant even if it is an unknown
constant.

Not intending to confuse you, but the confidence intervals are random
intervals when they are built from sample estimates.

What I think he should of said was, The probability of at least one
non-detect(success) is 67.7% given the true probability is 10%. This
in no way has anything at all to do with confidence levels.

I wish I understood what you were trying to say in those sentences.

I'm I understanding this correctly or can the above be stated as a
confidence level?
Any help would be greatly appreciated.

I am not sure. Sometimes it takes a bit of back_and_forth before ideas
get clarified.

--
David Winsemius

.



Relevant Pages

  • Re: Probability vs. Confidence Levels
    ... but ties it to a confidence level. ... The current process calculates the percent detection as ... being equal to the percentage of sampled faults that were ... 32.3% probability of 90% fault detection. ...
    (sci.stat.edu)
  • Re: The Consise Cantor Disproof
    ... > confidence level of having being randomly generated. ... same probability distribution, AND 3) that each event has ... you suck even worse at statistics than ...
    (sci.logic)
  • Shotgun statistics
    ... I've been thinking about the problem of using a confidence level of ... of null and alternate hypotheses that can be investigated (e.g. the ... astrobank dataset used for investigating astrology). ... then the probability ...
    (sci.stat.math)
  • Re: Comparing fractions (or proportions)
    ... Confidence Level *** The confidence level is the ... the significance level is the ... probability of a difference that large or larger is ... called the alpha value of the test. ...
    (sci.stat.math)
  • Re: Simple confidence interval
    ... Say I run 10 trials and I get 7 successes. ... Is there a way to calculate a probability range (such ... You can obtain confidence intervals for the binomial parameter by using the relationship between the binomial distribution and the beta distribution and the relationship between the beta distribution and the F distribution. ... Let x be the observed number of successes, n be the number of trials, and 1-alpha be the confidence level. ...
    (sci.stat.math)

Loading