The World's Largest Coalition of Nontheists and Nontheist Communities!

Summary Judgments

I'd like to open a discussion about "summary judgments." Given that it's impossible to know everything, how do we understand what is quackery and what is decent science. If we are really freethinkers seeking knowledge independent of tradition or authority, then how do we decide? I've never collided any particles to determine the accuracy of quantum mechanics.
So scientists, presumably, at some point, have properly executed the scientific method. They posed a hypothesis, did experiments, and let the world speak for itself. Some of them, on the other hand, found a decent marketing opportunity, mocked up a fake CNN set, and told us Glucosamine will repair our joints.
So here's the question, what is a good set of procedures to help us find the good science and avoid the random claims, without having to fly through space, or use a supercollider, or mix dangerous chemicals.

Jason
ps. both judgement and judgment are correct although judgement is sometimes listed as an error.

Tags: method, scientific

0 members like this

▶ Reply to This

Replies to This Discussion

Permalink Reply by Richard Lawrence on February 12, 2009 at 8:55pm

To start off I would recommend Carl Sagan's baloney detection which can be found here:

http://users.tpg.com.au/users/horsts/baloney.html

This would be something one could immediately use to navigate through various truth claims and focus on substance rather than how nifty the TV studio looks. A long term strategy might be picking a book up on informal logic so your vetting process automatically excludes claims based on shoddy reasoning.

Regards,

Rich

▶ Reply

Permalink Reply by Mike Hein on February 18, 2009 at 11:09am

I usually look at the publication in which the research was found. Peer-reviewed journals don't have much hooey-science in them. This doesn't mean that the research is infallible, of course, but does set a reasonable standard and a certain level of (dare I say) faith is warranted that the entire review board of a journal isn't trying to pull one over on us. It IS a hard thing to validate while surfing the net and wading through the huge glut of scientific information and other mis-information.

Good topic though!

▶ Reply

Permalink Reply by Andrew Mylko on August 26, 2009 at 6:12pm

If we were certain about anything than we would be theists, IMO.

As for distinguishing quackery from "decent science", I examine the language to evaluate the intelligence of the writer, and I also examine the research sponsor. I lookout for possible agendas or motives to deceive. Do they have something to gain? Is there a conflict of interest? It's highly circumstance specific.

In the case of Glucosamine - is the article from a source that has ties to supplement manufacturers? Plus, CNN is low on the totem pole of academic credibility. Academic journals are the way to go. I would also look for literature from people who are critical of the drug.

▶ Reply

Permalink Reply by JayBarti on August 26, 2009 at 6:26pm

Personally I always watch out for "certainties", good science doesn't tend to speak in terms of absolutes or perfect truths. That is usually my #1 bells going off that what I am dealing with is not necessarily reliable.

Comments are always a nice place to look as well, you can see what the common consensus is, and who believes it.

Personally a lot of people are down on Wikipedia and Google, but if you know how to use them, and have a healthy dose of skepticism when you read the results, you can often stumble upon some nice science stuff, a lot off on-line science publications, unless they are behind a pay wall usually let google freely trawl their stuff.

Snopes.com and straightdope.com are nice one stop shops for common public mis-conceptions.