Statistics Tutorials


Against All Odds VIDEOS
Now in DVD format.
Teaching Videos from Annenberg/PBS.
A video instructional series on statistics for college and high school classrooms.
Special Pricing $20 off!
Click here for Against All Odds info
Articles in scientific journals routinely report the results of studies. Based on these results, important decisions are made. For example, new drugs are often tested against standard drugs to determine if the new drug is more effective. Or, several methods of manufacturing may be compared to select the best technique for fabricating a component. Or, evidence may be examined to determine if there is a possible link between one activity and a result (e.g., asbestos and lung cancer). In most of these kinds of studies, results are commonly summarized by a statistical test, and a decision about the significance of the result is based on a pvalue. The reader of an article must decide, like a juror on a criminal case, if the evidence is strong enough to believe. Assuming the study was designed according to good scientific practice, the strength of the evidence is contained in the pvalue. Therefore, it is important for the reader to know what the pvalue is telling you.
To describe how the pvalue works, we'll use a common statistical test as an example, the Student's ttest for independent groups. For this test, subjects are randomly assigned to one of two groups. Some treatment is performed on the subjects in one group, and the other group acts as a control  where no treatment or a standard treatment is given. For this example, suppose group one is given a new headache medicine and group 2 is given then standard headache medicine. Time to relief is measured for both groups. The outcome measurement is assumed to be a continuous variable which is normally distributed, and it is assumed that the population variance for the measure is the same for both groups.
For this example the sample mean for group one is 10 and the sample mean for group two is 12. The sample standard deviation for group one is 1.8 and the sample standard deviation for group two is 1.9. The sample size for both groups is 12. Entering this data into a statistical program will produce a tstatistic and a pvalue. The WINKS Statistical Data Analysis program reports a calculated t = 2.65 with 22 degrees of freedom, and a pvalue of 0.0147. This means that you have evidence that the mean time to relief for group one was significantly different than for group two.
To interpret this pvalue, you must first know how the test was structured. In the case of this twosided ttest, the hypotheses are:
H_{o}: u_{1} = u_{2} (Null hypothesis:means of two groups are equal)
H_{a}: u_{1} <> u_{2} (Alternative: means of the two groups are not equal)
A low pvalue for the statistical test points to rejection of the null hypothesis because it indicates how unlikely it is that a test statistic as extreme as or more extreme than the one given by this data will be observed from this population if the null hypothesis is true. Since p=0.015, this means that if the population means were equal as hypothesized (under the null), there is a 15 in 1000 chance that a more extreme test statistic would be obtained using data from this population. If you agree that there is enough evidence to reject the null hypothesis, you conclude that there is significant evidence to support the alternative hypothesis.
The researcher decides what significance level to use  that is, what cutoff point will decide significance. The most commonly used level of significance is 0.05. When the significance level is set at 0.05, any test resulting in a pvalue under 0.05 would be significant. Therefore, you would reject the null hypothesis in favor of the alternative hypothesis. Since you are comparing only two groups, you can look at the sample means to see which is largest. The sample mean of group one is smallest, so you conclude that medicine one acted significantly faster, on average, than medicine two. Using standard APA journal format, this would be reported in an article using a phrase like this: "The mean time to relief for group one was significantly smaller than for group two. (two sided ttest, t(22) = 2.65, p=0.015)."
Pvalues do not simple provide you with a Yes or No answer, they provide a sense of the strength of the evidence against the null hypothesis. The lower the pvalue, the stronger the evidence. Once you know how to read pvalues, you can more critically interpret journal articles, and decide for yourself if you agree with the conclusions of the author.
For more tutorials... go to Tutorial HOME
For more information... we recommend:
WINKS  a simple to use and affordable statistical software program that will help you analyze, interpret and writeup your results. Download a free trial copy.
Against All Odds VIDEOS  Now in VHS or DVD formats Teaching Videos from Annenberg/PBS Click here for info
BeSmartNotes Reference sheets for SAS, SAS ODS, SPSS and WINKS  Click here for info.
Statistical Analysis Quick Reference Guidebook: With SPSS Examples is a practical "cut to the chase" handbook that quickly explains the when, where, and how of statistical data analysis as it is used for realworld decisionmaking in a wide variety of disciplines. It contains examples using SPSS Statistics software. In this onestop reference, the authors provide succinct guidelines for performing an analysis, avoiding pitfalls, interpreting results, and reporting outcomes. Paperback. Sage Publishers ISBN: 1412925606 Order book from Amazon
 Send comments  Tutorial Index  WINKS Software  BeSmartNotes 
© Copyright Alan C. Elliott, 19962012 email:stats@texasoft.com
WINKS Statistical Software www.texasoft.com 