科学研究中的再现性危机
日期:2019-10-25 10:35

(单词翻译:单击)

 MP3点击下载

In 2011, a team of physicists reported a startling discovery: neutrinos traveled faster than the speed of light
在2011年,一支物理学家团队发表了一项新发现:中微子的传播速度大于光速,
by 60 billionths of a second in their 730 kilometer trip from Geneva to a detector in Italy.
中微子走完经日内瓦到意大利探测站全长730千米的路途,大约快了600亿分之一秒。
Despite six months of double checking, the bizarre discovery refused to yield.
尽管用了六个月的时间再三确认,这一奇异的发现依旧如此。
But rather than celebrating a physics revolution,
研究人员并没有庆祝这一物理大发现,
the researchers published a cautious paper arguing for continued research in an effort to explain the observed anomaly.
他们反而在报纸上刊登了一篇警示性的文章,主张继续研究,从而解释观察到的异常现象。
In time, the error was tracked to a single incorrectly connected fiber optic cable.
与此同时,有人指出,造成此异象的原因是研究者追踪了一条错误连接的纤维光缆。
This example reminds us that real science is more than static textbooks.
这个例子告诉我们,真正的科学远不止不变的教科书。
Instead, researchers around the world are continuously publishing their latest discoveries
全世界的研究者仍持续不断地发表着他们的最新研究成果,
with each paper adding to the scientific conversation.
每篇新文章都参与到科学交流中。
Published studies can motivate future research, inspire new products, and inform government policy.
发表的研究成果可以促进未来的研究,启发新产品的制造,并提示政府政策上的革新。
So it's important that we have confidence in the published results.
所以我们对于结果发表的正确性拥有信心是很重要的。
If their conclusions are wrong, we risk time, resources, and even our health in the pursuit of false leads.
如果它们的结论是错误的,我们就冒着浪费时间、资源甚至是健康的风险去跟随错误的引导。
When findings are significant, they are frequently double-checked by other researchers,
当有重大发现时,这些成果通常都会被其他研究者再三确认,
either by reanalyzing the data or by redoing the entire experiment.
或者重新分析数据,或者将整个实验重新再做一遍。
For example, it took repeated investigation of the CERN data before the timing error was tracked down.
比如,欧洲核子研究委员会对实验数据进行了重复性调查才追踪到计时误差。
Unfortunately, there are currently neither the resources nor professional incentives
不幸的是,当下既没有资源也没有专业设备,
to double check the more than 1 million scientific papers published annually.
去重新检验每年超过一百万的新发表成果,
Even when papers are challenged, the results are not reassuring.
即使论文受到质疑,这样的结果也无法让人安心。
Recent studies that examined dozens of published pharmaceutical papers
最近一项研究检验了很多已发表的药学论文,
managed to replicate the results of less than 25% of them.
论文中的结果可被复制的不到百分之二十五。
And similar results have been found in other scientific disciplines.
其他科学验证中也出现了相同的问题。
There are a variety of sources for irreproducible results.
论文中的结果无法被重现的原因有许多。
Errors could hide in their original design, execution, or analysis of the data.
实验的原设计、执行,或是关于数据的分析,都有可能藏有错误。
Unknown factors, such as patients' undisclosed condition in a medical study,
还有未知因素,譬如说在药物研究中患者的未公开隐疾,
can produce results that are not repeatable in new test subjects.
就会使得实验的结果无法被复制。

科学研究中的再现性危机

And sometimes, the second research group can't reproduce the original results
而且有时,第二实验小组不能复制先前实验结果,
simply because they don't know exactly what the original group did.
只是因为他们不知道先前的实验小组做了什么。
However, some problems might stem from systematic decisions in how we do science.
然而,一些问题可能源于人类研究科学的体系。
Researchers, the institutions that employ them,
研究者、研究学院,
and the scientific journals that publish findings are expected to produce big results frequently.
以及发表研究成果的科学期刊,都被要求迅速地产生新的重要成果。
Important papers can advance careers, generate media interest, and secure essential funding,
一篇重要的论文可以帮助事业的发展,聚集媒体目光和保证重要的研究资金,
so there's slim motivation for researchers to challenge their own exciting results.
所以研究者一般不会自己质疑自己的研究成果。
In addition, little incentive exists to publish results unsupportive of the expected hypothesis.
而且很少会有鼓励研究者发表不支持预计假设的研究成果的情况。
That results in a deluge of agreement between what was expected and what was found.
这造成了如今泛滥的与期望的一样的研究结果。
In rare occasions, this can even lead to deliberate fabrication, such as in 2013,
在极端情况下,这还会造成捏造成果的现象,比如在2013年,
when a researcher spiked rabbit blood with human blood to give false evidence that his HIV vaccine was working.
一位研究者把兔子的血液加入人的血液中,从而给出错误的证据表明他的艾滋疫苗是有用的。
The publish or perish mindset can also compromise academic journals' traditional peer-review processes
这种不是“发表”就是“消亡”的心态,还危及到了学术期刊传统的同行评审过程,
which are safety checks where experts examine submitted papers for potential shortcomings.
这是一种安全检查,专家会检测上交的论文中出现的潜在漏洞。
The current system, which might involve only one or two reviewers, can be woefully ineffective.
如今的系统只会有一到两个评审,这可以被看做是无效的。
That was demonstrated in a 1998 study where eight weaknesses were deliberately inserted into papers,
这在1998年的一场研究中得到了证实,人们把八项漏洞放在了论文中,
but only around 25% were caught upon review.
然而只有四分之一的漏洞在评审过程中被找出。
Many scientists are working toward improving reproducibility in their fields.
很多科学正在努力提高其研究领域的可重复性。
There's a push to make researchers raw data, experimental procedures,
人们正在促进研究者的原始数据、实验过程
and analytical techniques more openly available in order to ease replication efforts.
和分析方法更加开放、共有,这样可以减少重证结果的难度。
The peer review process can also be strengthened to more efficiently weed out weak papers prior to publication.
评审过程也可以被加强,在论文发表之前更有效地找出他们的漏洞。
And we could temper the pressure to find big results by publishing more papers that fail to confirm the original hypothesis,
我们还可以通过发表更多与预计假设不符的研究成果,来缓解寻找重大研究成果的压力,
an event that happens far more than current scientific literature suggests.
而结果和预计假设不符的情况远远比现在被发表的结果所展示的多。
Science always has, and always will, encounter some false starts as part of the collective acquisition of new knowledge.
科学,永远有,也永远会遇到一些错误的开始,这是获取新知识的过程的一部分。
Finding ways to improve the reproducibility of our results
找到一种可以提高我们研究成果可重现性的方法,
can help us weed out those false starts more effectively, keeping us moving steadily toward exciting new discoveries.
可以帮助我们更有效地揪出那些错误的开始,让我们更顺利地去找寻新的发现。

分享到