Sunday, September 25, 2011

Anecdotal v. Scientific Evidence

While preparing to tape a new program the other day, I caught ten minutes of Dr. Oz talking about preventing Alzheimer’s. You can watch at www.doctoroz.com/. Among the things suggested were consuming hard boiled eggs, coffee, Brazil nuts and vitamin E. I love that coffee is in that list.

If you can believe Wikipedia, (and you DO know that sometimes you can't, right?) Dr. Oz is a highly credentialed cardiac surgeon. If you’ve ever watched him on TV, you’ve noticed how passionate he is about what he believes. He recommended another supplement that I just have to take if I want to keep my brain healthy. Ugh. Add another to the eleven capsules I already take? No thank you. But I can make sure I get my daily egg and coffee.

New research was mentioned, but not cited, and this got me to thinking about one of my pet peeves. So, here comes the rant.

Have you noticed how many experts have cropped up over the past ten years? A truckload. (I’m using the word "expert" loosely here.) They’re on TV, the Internet, radio, and in print. Upon close examination, I discovered that most of them are selling something. Although they are passionate, claims are made with little or no evidence to back them up.

[Side Bar]

A search of the origin of "expert," reveals (according to Merriam Webster online) that the word was first used in the 14th century. I conclude, therefore, there were no experts before then. I’m making this observation to stress a point, so stay with me on this.[End Side Bar]

Recently, I watched almost an entire video infomercial that repeatedly made unsubstantiated statements reeking of food industry conspiracy. Some of what was said on the video regarding eating habits jibed with my knowledge base, but for me the video makers’ credibility was damaged over and over as they warned of the evil money hungry food corporations tricking us into buying their stuff. As I listened and watched, I recognized two false statements aimed at the dairy industry. This is a trend, it seems. In order for me to sell my product, I must declare how rotten yours is, how it’s killing people or better yet, there’s a conspiracy afoot.

How can they make such statements? What evidence have they to back them up? Did Uncle Harry get a wart after, say, drinking diet soda? Is that all ya got?

What then are these many reports based on? In my opinion, mostly anecdotal evidence, which can best be defined as "observations that make an interesting story" (M-W online), and not on scientifically gathered evidence with controls and observations that can be duplicated by others to verify the outcomes and, therefore, the claims. Check back at my Side Bar for a poke at anecdotal evidence.

Because (1) anyone can write a blog, obtain a domain name, and/or go into business, and (2) fear of illness and death is a big motivator, they’re making a killing. (No pun intended.) Sifting through false claims and hyperbole is essential to discovering the truth. Nevertheless, good luck to you in finding it.

A lot of health related information rely on anecdotal evidence, mixed in with some scientific-sounding stuff to, perhaps, obscure the fact that no real science backs up the claims. I’m guessing, because I often get turned off by hyperbole and stop reading/listening/watching. And all those SOLID CAPS and exclamation points don’t help either. That's amateurish, shoddy writing coupled with hyperbole--a death blow to my attention. Furthermore, the research sited is often done in Europe [not that’s anything wrong with that ;-)], and published in some obscure journal, like The Lower Slobbovian Journal of Obscurities.
Where is Lower Slobbovia?

Reminds me of the television ads of my youth: Four out of five doctors recommend. Well, who are they? And were there only five?

Now, I’m not saying that anecdotal reports aren’t valuable. In fact we use them daily. Book reviews on Amazon.com, or movie reviews on Blockbuster’s site, help me choose whether or not to purchase an item. There are sites that rate hotels, restaurants, appliances . . . you name it. What I take issue with is less-than accurate claims made to scare me into purchasing something I don’t need, with a small chance it will make a difference in my well-being, as compared to, say, getting enough rest and eating a balanced diet.

If a person or a business entity makes statements regarding health issues, products, or procedures, I for one would appreciate documented evidence in place of hyperbole (see definition #2).

[Side Bar]

hyperbole [hahy-pur-buh-lee] noun: Rhetoric
From the Greek meaning throw beyond1. obvious and intentional exaggeration.
2. an extravagant statement or figure of speech not intended to be taken literally
[End Side Bar]

Another tool of advertisers is statistics. Statistics can be used to lend credence to a claim. But what do the numbers mean? How was the data collected? Who or what was the study group? Let’s say you want to sell some cookies. You have four kids who love your cookies. Statistically, you could say, 100% of those surveyed said the cookies are delicious. Better than Grandma’s. That may be honest, but is it real evidence? Wouldn’t a sample population of 50 or even 100 be a better test group?

Lest you go away wondering: a word about conflicting claims. New discoveries emerge daily, and studies disprove previously held beliefs. For instance, 150 years ago, according to an old Modern Health textbook, tobacco was recommended to treat asthma. No kidding.

Between fear and lack of knowledge, people are easily swayed by the less-then-accurate representations made by purveyors of tonics, oils, supplements, and the like. (No interviews, no data–simply my undocumented observations and humble anecdotal opinion.)

By the way, kudos to those who substantiate their claims.

The world offers a vast assortment of information. Be diligent, gentle reader, to distinguish the good from the bad. And as a character in one of my favorite old TV shows (Hill Street Blues) would say, "Hey! Hey! Hey! Be careful out there."

1 comment:

  1. "Sifting" is a good word. There is too much information that must be sifted through to make any sense of it all. I retreat to medical on-line journals and databases to substantiate claims - most of which cannot meet the evidenced-based bar it seems. I have my own opinions about the food industry - mainly - they are out to sell food!
    Fact: the standard American fare does not promote health. It's not the food industries fault. They sell food. As >60% of Americans are technically "overweight or obese", that is, weighing 10 - 30% more than a body should, there is pretty strong evidence that eating w/the masses will lead to "overweight plus" and all it's concomitant diseases. I know we will all die at some point but I would like a body and mind that works while I'm here. To accomplish that, I have stepped from the well-trod path to the trough. Bon appetit!

    ReplyDelete

Corona Blues, Part Deux

Since I began this blog, states and counties have moved to Stages 2 and 3, with Ventura County opening up restaurants -- with guidelines, an...