Question

A study was reported as failing to achieve statistical significance at the 5% level: its p-value was 5.2%. A second study of the same subject by a different researcher was determined to be statistically significant, with p-value 4.99%. The two studies found the same estimate for the mean difference and were of equal quality.

Q. Discuss how you would view the results. (using statistic knowledge and terminology)

Answer 1

Study I : was reported as failing to achieve statistical significance at the 5% level: its p-value was 5.2%

Study II : same subject by a different researcher was determined to be statistically significant, with p-value 4.99%

two studies found the same estimate for the mean difference and were of equal quality.

criteria for statistical significance is to check if p < alpha.

Even though the value of mean are same the level of p value is different.

In case 1, p ( 5.2% ) > alpha ( 5% )

The probability of error in the obtained mean is 5.2%, where as our level of required significance is 5%. Hence, the value is not statistically significant.

In case 2, p ( 4.99% ) > alpha ( 5% )

The probability of error in the obtained mean is 4.99%, and our level of required significance is 5%. Hence, the value is statistically significant.