Nearly 80 percent of radiation oncology studies funded by the National Institutes of Health involve investigating the effects that radiation has on tumor cells and healthy tissue in pre-clinical settings, such as experiments done in cell cultures or mice. A majority of these radiation biology studies, however, have serious flaws in how their irradiation methodology is described, which makes them very difficult to replicate, according to a new finding from the University of Maryland School of Medicine (UMSOM).

Important details in the irradiation protocol and the experimental setup are routinely not included in most of these journal articles, which could lead to dose variations or other errors when other researchers try to repeat the experiments in their own laboratories.

"Glaring omissions or errors in the methodology sections of radiation biology journal articles make the studies very difficult to reproduce, interpret, and compare with other research," said study principal investigator Yannick Poirier, PhD, Assistant Professor in the Department of Radiation Oncology at UMSOM.
In the new study published this month in the International Journal of Radiation Oncology Biology and Physics, Dr. Poirier and his colleagues from UMSOM and the University of Washington, Seattle, reviewed 1,758 peer-reviewed studies from 469 journals that were used in pre-clinical studies to evaluate the effects of radiation therapy to treat malignant tumors and other conditions. Specifically, they examined the journal article's "methods" section that described the radiation protocol used.

The researchers found that the source of radiation used in the study (such as low vs high energy X-rays or gamma rays) was unclear or ambiguous in nearly 14 percent of the studies they reviewed. They also found that only 1 percent of studies listed the protocol the researchers used to calibrate the machines, and only 16 percent named the equipment used to measure the absorbed radiation dose.

Several publications were found to contain outright errors where a quantity of radiation dose was misreported. In a few cases, researchers found descriptions of "unachievable" experiments including irradiation produced by a linear accelerator at energy levels that would have been impossible for the named device to produce.

The authors graded the level of physics reporting necessary to successfully reproduce the experiment on a scale of 1(worst) to 10 (best) and found that only 3 percent of the journal articles would receive a score of 8 or above. "Disturbingly, articles published in higher impact journals -- and, consequently, those that are higher cited -- scored the poorest. This means that these studies with poor-quality physics are being propagated and are amplifying the reproducibility problem," said study co-author Amit Sawant, PhD, Associate Professor and Chief of the Division of Physics in the Department of Radiation Oncology at UMSOM.

Rad Oncology Homepage