One thing we all have to do as skeptics is see what other people are saying or studying and evaluate it to see if it stands up. No one person can do all the research needed in even just one subject. Lots of scientists and people need to contribute to science in many different ways. There's a system set up where studies are peer reviewed. Science involves lots of people, so it's not perfect but it is self-correcting and it's by far the best way to go about understanding and learning about the universe.Never rely on one scientist. That would be an appeal to authority. It's not to say you can't look to a scientist and value his work, but it should be peer reviewed and replicated by others as well. Scientists really do need to stand on the shoulders of giants, and to have other scientists stand next to them.
The other day I was listening to an older episode of The Skeptic's Guide to the Universe: Episode 123 and Dr. Steven Novella was talking about this subject, regarding fringe science. It was interesting enough that I transcribed part of the episode to share with you. You can extrapolate this information when reading about studies done especially in the paranormal/fringe areas.
First he was talking about how scientists have to study scientific literature. As skeptics we also have to at least have a grasp on how things work. Also he explains where skeptics come in. Here's what he said:
39:35 You have to develop the ability and the skill to interpret the literature, even if you're not doing research in that area. What scientific skeptics are trying to do is provide the kind of peer review and critical analysis that typically happens in mainstream science, and apply that to more of these fringe areas because mainstream scientists are ignoring it, out of hand, usually.
A few minutes later, Dr. Novella was talking about science that claimed to verify the supernatural (psychic dogs and other phenomena. Listen to the whole episode for the complete story).
44:47 In order for science to be compelling enough to establish a new phenomenon in science, we need to see a few things, all at the same time:
- Science that has good methodology, where any artifacts are weeded out.
- Results that are statistically significant.
- Replication, so we know it's not just one lab or one scientist.
- An effect size that is above noise.
That doesn't even include a mechanism which would be the icing on the cake.


