In Defence of Small Effects: Why Any Signal in Language is Amazing
Published:
A few months ago, a paper of mine came back from peer review with a comment I have seen in various forms throughout my career. The reviewer acknowledged that the results were statistically significant, then added, almost as a dismissal: “but the effect sizes are small.” The implication was clear: if the variance explained is modest, the finding is modest. I want to push back on that, not defensively (well, perhaps a little defensively), but because I think this criticism, applied to research on the internal structure of language, fundamentally misunderstands what it would mean to find a large effect, and why finding any effect at all is pretty amazing.
