Sunday, December 29, 2019

Meta-analysis study indicates we only publish positive results

Meta-analysis study indicates we only publish positive results

Enlarge (credit: Andrew Brooks | Getty Images)

While science as a whole has produced remarkably reliable answers to a lot of questions, it does so despite the fact that any individual study may not be reliable. Issues like small errors on the part of researchers, unidentified problems with materials or equipment, or the tendency to publish positive answers can alter the results of a single paper. But collectively, through multiple studies, science as a whole inches towards an understanding of the underlying reality.

A meta-analysis is a way to formalize that process. It takes the results of multiple studies and combines them, increasing the statistical power of the analysis. This may cause exciting results seen in a few small studies to vanish into statistical noise, or it can tease out a weak effect that's completely lost in more limited studies.

But a meta-analysis only works its magic if the underlying data is solid. And a new study that looks at multiple meta-analyses (a meta-meta-analysis?) suggests that one of those factors—our tendency to publish results that support hypotheses—is making the underlying data less solid than we like.

Read 13 remaining paragraphs | Comments

https://arstechnica.com

No comments:

Post a Comment

Baidu reports Q1 revenue up 1% YoY to ~$4.4B, above ~$4.35B est., the slowest growth in over a year, and net income down 6% YoY to ~$755M, above ~$554M est. (Zheping Huang/Bloomberg)

Zheping Huang / Bloomberg : Baidu reports Q1 revenue up 1% YoY to ~$4.4B, above ~$4.35B est., the slowest growth in over a year, and net ...