Junk science is a big problem for the autism community, whether it involves the discredited vaccine theory or the bogus "complementary and alternative" treatments that unscrupulous vendors peddle to desperate parents.
Many articles and blog posts arguing for the vaccine-autism link have the trappings of genuine academic research: tables, graphs, citations, and scientific jargon. Some of the authors have credentials such as M.D. or Ph.D. degrees. None of these things is a guarantee of scientific value, as the history of science is full of crackpot theories (e.g., AIDS denialism) that are the heavily-footnoted products of people with letters after their names. But most people will not be able to spot the scientific weaknesses of such work. Outside of academia, few understand concepts such as peer review. Jordynn Jack describes one dubious article that appeared in a non-peer-reviewed publication: “Regardless of the scientific validity of the article, though, the writers perform the writing style quite effectively. It would be difficult for the layperson to distinguish this article from any other scientific research paper, especially if one did not investigate the nature of the journal … or of the scientific response to the article.”Alisa Opar writes at The Atlantic and Spectrum:
For most parents, who have little understanding of how science is done, wading through claims made about alternative treatments can be befuddling. Even when someone knows to search PubMed, an online database of journal abstracts, she might not understand that obscure journals tend not to be taken seriously, and might not pick up on the difference between types of studies. A case report about a single child may be of purely scientific interest as an avenue for further investigation, for instance, whereas results from a rigorous randomized controlled clinical trial with a large number of participants can provide solid information on whether a treatment works.
What’s more, media outlets often exaggerate the significance of findings. Take secretin, a peptide hormone that stimulates the secretion of digestive fluids from the pancreas. In the late 1990s, three children with autism were reported to improve dramatically after taking secretin. (The caveat is that this was an unblinded study—that is, the investigators were aware that all three children had received secretin and not a placebo.) Word spread, parents heard about it on the news, and demand for secretin skyrocketed. But more than a dozen subsequent double-blind studies—in which neither the families nor the researchers knew which participants were in the placebo arm—found no evidence of effectiveness.
“As a scientist, you can end up on the front page of the science section of The New York Times with a new link to autism, but not really know if it’s causal,” says Catherine Lord, a clinical psychologist who heads the Center for Autism and the Developing Brain at New York-Presbyterian Hospital in New York City. In other words, just because researchers find a connection between autism and a gene or some other factor does not mean that it causes the condition—or that blocking it can reverse the effects of autism. “I think it’s probably very confusing for parents. So when someone says, ‘I can take what that scientist said and make it meaningful for you right now,’ that’s incredibly appealing.”