Defining smokers and vapers
I was looking through an old piece of “research” the other day.
It got me thinking.
I have always had a very low regard for any “research” that is based on statistics and in particular where those statistics are based on questionnaires. The example I was reading cites a perfect demonstration of where a vital piece of information is omitted giving a wholly false impression –
He noted that the survey results challenge the common assumption that all adolescents who use vaping products are inhaling, and possibly becoming addicted to, nicotine.
This is followed by –
Between 65% and 66% of students in each grade reported vaping “just flavoring” the last time they vaped
So here we have the Antis screaming blue murder that kids are getting hooked on Nicotine [how many times have we heard that?] when in fact they are just enjoying a harmless flavour, akin to sucking a lollypop.
Of course it goes deeper than that. This piece of work seems to be relatively honest in that at least they are pointing out flaws in previous work, but even they fall into another trap: talking about “vaping experience” and “using e-cigarettes”. What do those mean? How many times does the subject have to vape before they are classified as a vaper? Apparently, just once is enough. A kid is poking around his brother’s bedroom and finds an electrofag. He takes a suck but decides he doesn’t like it. He is however now regarded as a “vaper”?
Cigarettes are even harder to define. What constitutes a smoker? We immediately think of the 20+ a day regular, but what about someone who might have a cigarette on a Friday night out? What about the person who sucks but never inhales [a bum puffer!]? What about the person who does get through 20 a day, but in practice stubs them out after a couple of puffs? What about the person who lights up and then just lets the fag burn away on the side of an ashtray? According to the Antis, the one-fag-of-a-Saturday smoker is classed as a regular along with the 60 a day pro.
One of the commonest questions asked in these surveys is “Have you smoked/vaped in the last 30 days?”. This is factually meaningless. A kid takes a quick puff of an electrofag and doesn’t like it. He then tries an old style cigarette but doesn’t like that either. Yet according to the Antis, we now have and example of a child experimenting with electrofags and then “moving on” to conventional cigarettes.
I have an electrofag but I very rarely use it, but does the fact that I have used it on more than one occasion make me a regular vaper? I would say definitely not, but the Antis would disagree. I have partaken of some highly illicit substances in the past, but does that make me a drug addict?
So what does constitute a smoker or a vaper?
Is it any wonder I treat such “research” with contempt?
“Have you smoked/vaped in the last 30 days?”. This is factually meaningless.”
Surely, it’s specifically designed that way? How else can the weasels prove what they want to prove?
Of course it’s designed that way. The response could be factually correct but it makes no differentiation between an experimenter [just one], a very casual smoker [one or two on Saturday night] and a heavy smoker [60 a day or more].
Equally all these studies and questionnaires rely on two things – an impossibly precise memory and complete honesty. Unless someone buys one 20-pack every day and smokes every one without fail, the number is going to be inaccurate or at the very least a best-guess. And how many 40 a day smokers tell their doctor they smoke 20 [or less]? Hah!
Having friends who spend their lives with statistical research, the first question is to ask to see the fieldwork of the findings.
Even sample size is irrelevant if that sample is not a representative cross-section.
Anthony Wells of YouGov published a good piece on bad sampling on Tuesday
http://ukpollingreport.co.uk/blog/archives/9805
There are another factors that are common to just about every report that is produced these days – risk and relative risk.
They run experiments on mice [usually with an extreme level of the “toxin”. A mouse develops symptoms of a disease and they loudly proclaim that there is a “risk” of the toxin causing the disease, ignoring the levels of exposure and the simple fact that a mouse isn’t a human.
Now suppose the normal risk of catching this disease is .000001% and their results show that .000002% off the mice succumb, they then scream from the roof tops that the toxin doubles the risk, or it increases risk by 100%. Technically both statements are correct but are misleading to the extreme. i.e. there is still no risk of any consequence.
Generally, what we receive is so filtered by a determination to find results that fit the thesis proposed that any number pointing in a particular direction will be used.