Question

When testing a new treatment, what is the difference between statistical significane and practical significane? Can. treatment have statistical significane, but not pratical significane

Answer 1

We use p- value to determine the statistical significance in testing of hypothesis, as sample size increases the hypothesis test have greater statistical power. Statistical evidences indicates that we have sufficient evidene to conclude that effect exist.

if experiment with 99% significance level, tha is while determining answer we could be 99% confident that observed results are real and error is not caused by randomness, and also there is 1% chance that we could be wrong.

Practical significance related to the magnitude of the effects. statistical test cannot help for whether the effect is large enough to be important in our study.

In Statistical significance result is not likely to occur by chance.In practical significance we have to use our subject area knowledge, and treatment makes enough difference to justify its use.