No difference and type II error – a guideline?

Domb and Sebatian discuss about type II error in a “Level V guideline“. Among other things they conclude: Type II errors may be present in greater than 20% of studies that fail to find statistically significant differences. Incorrectly concluding that there is no difference in such studies poses a danger to the advancement of clinical practice, and indeed […]

No evidence of no evidence

In the null hypothesis significance testing framework, failure to reject the null is never evidence in support of null. However, it is extremely common that failure to reject the null, ie. getting a p-value larger 0.05 is interpreted as “no difference” or “no evidence”. As many experts have said, “absence of evidence is not evidence […]