“Only 0.13 percent of education articles published in the field’s top 100 journals are replications, write Matthew Makel, a gifted-education research specialist at Duke University, and Jonathan Plucker, a professor of educational psychology and cognitive science at Indiana University. In psychology, by contrast, 1.07 percent of studies in the field’s top 100 journals are replications, a 2012 study found.
Makel and Plucker searched the entire publication history of the top 100 education journals – ranked according to five-year impact factors — for the term replicat*. They found that 221 of 164,589 total articles replicated a previous study. Just 28.5 percent were direct replications rather than conceptual replications. (Only direct replications, which repeat an experiment’s procedure, can disconfirm or bolster a previous study. Conceptual replications, on the other hand, use different methods to test the same hypothesis.)
What’s more, 48.2 percent of the replications were performed by the same research team that had produced the original study. Attempts to replicate an experiment failed more often if there was no author overlap. When the same authors who published the original study published a replication in the same journal, 88.7 percent of replications succeeded. (The figure dropped to 70.6 percent when the same authors published in a different journal.) By contrast, replications conducted by new authors succeeded 54 percent of the time.”