Some people think this blog reports only report Vendors Behaving Badly, of which there is no shortage. Hence that’s what most of the posts are about.
However, on those rare occasions when a vendor does, in the immortal words of the great philosopher Peter Noone, something good, we report that too. It just doesn’t happen very often.
It seems that the Something Good for Jeff Greene and his colleagues at MedEncentive is that Buck Consultants, one of the five largest HR consulting houses in the world, is partnering with MedEncentive. This partnership, which resulted from Buck witnessing the effectiveness of their program, firsthand, will involve introducing the Program to Buck’s clients, as well as the adoption of the Program by Buck for its own employee health plan.
I have personally reviewed all of Medencentive’s results, both for validation by the Validation Institute and for publication, and can vouch for the fact that all their numbers add up, nothing contradicts anything else, and my “plausibility tests” are passed. I rarely make such bold assertions, both:
- to keep my track record intact (>500,000 words published, three arithmetic mistakes spotted), and
- because when the wellness industry makes such assertions, they are invariably wrong, usually obviously and hilariously so.
What excites me about this announcement is the fact that a health-improvement and cost containment solution, validated by the Validation Institute, is not only being endorsed, but also adopted by one of the largest HR consulting firms. Very impressive.
Good luck to Buck and MedEncentive!
In the immortal words of the great philosopher Britney Spears: “Oops, I did it again.”
For the fourth time in as many decades, I’ve been caught! This is not to say that I’ve only made 4 miscues in the most recent 4 decades. Just that I’ve only been caught 4 times in these 4 decades. Not including the time I caught myself actually thinking disease management (DM) saves money. Until then, basically everything I said was a lie, however unintentional, because in my naivete I thought DM worked. Silly me.
Jeff Hogan joins the few, the proud, who have called me out for saying things that aren’t exactly accurate. I’m putting this blog on top of the previous one to make it easier to track my cumulative miscues, in case you’re keeping score at home.
In this case, he referenced a study in Health Affairs showing that bundled payments reduced the cost of surgeries by 11%. I saw that abstract and immediately assumed that, like many other bundled payments, the reason the cost per procedure declined is that the number of procedures increased, by surgeons adding more “easier” and hence less costly procedures. This would reduce the cost/procedure but total costs would increase due to more procedures.
I couldn’t link through to that study (nor can you, most likely) from that abstract, to test that hypothesis. But since it is Health Affairs I just assumed that their peer review for that article is as sloppy as it is for wellness articles. Ron Goetzel published a nonsensical article there, which, among other things, concluded that only about 5.5% of the cohort smoked because only 5.5% of the cohort admitted they smoked, on a risk assessment. Since the US smoking rate is more like 18%, the correct conclusion would have been that two-thirds of smokers lie on risk assessments. I would have caught that in peer review but Health Affairs allows authors to pick their own toadies as peer reviewers.
So, without actually reading the Health Affairs study, I assumed they applied the same lofty standard of peer review to this article as to Goetzel’s:
They don’t appear to have tracked the number of cases. A classic thing hospitals and doctors do when they get paid per case is to perform surgeries on people who may not have needed them. These people will have lower-than-average costs and complication rates…but be reimbursed the same.Or, in the immortal words of the great philosopher Claude Rains, “Owing to the seriousness of this crime I’ve instructed my men to round up twice the usual number of suspects.
Jeff wrote back:
Al: Did you read the same Health Affairs article that I did? The citations and case tracking is quite detailed in the report and appendix. Not only did they carefully examine the number of cases but they used some very intensive methodologies for doing disruption analysis.
He helpfully attached a pdf. It turned out they had indeed tracked the number of referrals not going to surgery, and almost a third did not, in fact, go to surgery. This factoid never made it into the abstract, but was buried in the article.
So kudos to Jeff and if he sticks around another 8 years, 9 months and 22 days, at my current pace, I’ll be due for another mistake.
Guilty as charged. Someone called me out on yet another mistake buried in my 500,000 words published to date.
Yep, the number of members in the most exclusive club in healthcare outcomes analysis just rose by 33%, as Tom Milam of TrueLifeCare joins Corey Colman and Keith McNeil in justifiably calling me out.*
To put this track record in perspective, Ron Goetzel has been caught 14 times. You might say, well, 14 isn’t that much different from 3 in absolute terms. (In percentage, it is, but we’ll let that slide.)
Except that I needed an entire decade to rack up 3, while Ron needed only 45 minutes to tally 14. Over the decade, his number would be more like approximately eleventy zillion. It depends how you count the ones where he doctored numbers that were phony to begin with and then doctored them back again to the original phony numbers, after insisting that the doctored numbers were real. If you’ve lost track on all the doctorings that I just now published a companion blog post on it.
So what was the mistake?
[SPOILER ALERT: The rest of this post is boring.]
It’s kind of anticlimactic, and quite obscure. By way of background, I routinely analyze wellness-senstive medical event (WSME) rate trends for large employers and health plans. It’s not rocket science, but it’s totally valid. Indeed, it’s the only population-based observational analysis that is valid. (RCTs are not observational. But you knew that.). It was even embraced by Ron Goetzel’s very own outfit: the Health Enhancement Research Organization — before they realized that valid measures are the wellness industry’s kryptonite.
The WSME tally is also the only observational methodology accepted by the Validation Institute for employers and health plans.
Here’s what the national WSME rate looks like. (I think there was a reporting or transcribing error by one of the reporting states in 2005-2006, to the extent anyone noticed the inflection in the graph, or cares.) This graph of WSMEs shows that, over the decade+ period of the greatest growth of workplace wellness, that there was no improvement in event rates relative to the US population that would not have had access to workplace wellness — Medicare, Medicaid and the uninsured. Obviously their raw rates were higher. This is a difference-of-differences analysis.
Quite the contrary, it appears that if anything the employer-insured cohort trended worse than the control.
Tallying this rate requires our data extraction algorithm to collect ER and IP events primary-coded both to the disease in question, or else are common complications of the disease in question. We pick common complications based on two factors:
- How likely is someone with the disease in question to get the complication?
- How likely is it that the complication in question occurs in someone with the disease?
Remember, we only tally primary codes because we want to simplify the analysis enough that we can be 100% sure of comparability between any given payor and other payors comprising the benchmark. So we look for an “80-20 rule” in what we include in the primary code data extraction.
Our diabetes rate includes quite a number of complications that fit that description., one of which is cellulitis. Diabetics are much more likely than non-diabetics to get cellulitis in their extremities — feet in particular — because they often can’t feel a cut. (Also the skin on their feet can be thinner than it should be.) Likewise, cellulitis of extremities is much more likely to be diagnosed in diabetics than non-diabetics.
If you can’t feel it, you won’t treat it. And therefore your odds of cellulitis in your foot are high. However, cellulitis in non-extremities would correlate much more loosely with diabetes, since diabetics can still feel and see skin issues elsewhere on their bodies. Therefore, not all cellulitis codes, by a longshot, are included in our analysis.
While we included cellulitis of the foot (and leg, also common enough), we somehow — despite having done these analyses 20 to 30 times a year for 15 years — omitted cellulitis of the toes. Sort of like the Matisse painting hanging upside down in the Museum of Modern Art for 47 days, no one else noticed either. Yet even the most intellectually challenged members of the wellness industry’s self-anointed awards committee understand the anatomical fact that, technically speaking, the toe is part of the foot.
Le Bateau, Henri Matisse
Honestly, when all is said and done, this won’t change anyone’s results much, and all the changes will be in the same direction vs. history (which is also going to be recoded) and vs. the benchmark/average, likewise recoded. This is especially true in the working-age population, which comprises most of our analysis. Nonetheless, kudos to Tom Milam for becoming the third member of this most exclusive club.
*Your chances of joining this club are quite remote, statisically speaking. They are even more remote if you didn’t notice the arithmetic error just now. n increase in membership from 2 to 3 is a 50% increase, not a 33% increase. And the painting is still upside down…
Looks like, to paraphrase the immortal words of the great philosopher Robert Palmer, he has a bad case of lying to you.
What has he doctored this time, you might ask?
More like, what has he re-doctored. Longtime TSW fans will recognize the first part of this posting, but stick with it. There is a sequel.
First, he put out a doctored savings claimed for one of his friends, Health Fitness Corp. HFC had pretended to save massive amounts of money for Eastman Chemical, and Eastman Chemical pretended to believe them.
This slide was re-presented many times, often in a more readable format, including the lie reproduced below in larger print. that two years of savings predating the program should be attibuted to the program.
The 2007-2008 savings couldn’t be due to the program either, not just because the risk factors hardly budged (-3%, excluding dropouts), but because Ron himself said that it takes 2-3 years even to achieve a tiny reduction in risk, which of course in turn takes many more years to achieve a tiny reduction in cost.
Obviously, if the program didn’t start for 2 years after separating the participants and the non-participants, they can’t claim savings for the participants before there was even a program to participate in. Citing savings from nonexistent programs is a wellness industry tradition, starting with Safeway’s program. That was the one which formed the basis for the Affordable Care Act’s wellness incentive.
So every penny of alleged savings prior to 2006 was due to the study design rather than the program itself. It subsequently turned out that comparing participants to non-participants was completely invalid. I proved it using the wellness industry’s own data, and then two randomized control trials showed the exact same thing. Zero risk reduction attributable to the intervention.
So what did Ron do when it was pointed out that you can’t claim savings for a program that doesn’t exist? Nothing, at first. Then The Incidental Economist (TIE) got wind of Ron’s analysis and called it, to use their technical term, “crap.”
TIE is widely read, so Ron had to do something. Ron’s response was to call the graph “unfortunately mislabeled, using the passive voice, as though the graph reproduced itself.
He then doctored it, whiting out the labels altogether, yielding this rather sparse x-axis.
He then duly published an “erratum” — that’s Goetzel-speak for admitting you got caught — in the Koop Award application: Ron is affectionately known as “Goetzel the Pretzel” for the prowess he has achieved, honed by years of experience, in making lies sound like innocent mistakes, or “errata.” This one is a screenshot as it appears today on the site, and I just emailed it to myself so Ron, don’t even think of “disappearing” the evidence, as is your wont…
Hmmm…nothing in the active voice about who was responsible for this “mistake.” Perhaps the erratum just wrote itself.
And that brings us to Ron’s most recent sleight-of-hand, which is why a 10-year-old slide is back in the news. He recently re-doctored the original doctored savings slide, which now once again resides on the Koop Award website, along with the aforementioned “erratum” which he forgot to delete when he replaced the original phony savings slide with the doctored version of the phony savings slide (which is apparently now also compliant with “HIPPA”). Try reading that again — tough to keep up with all the deception.
Hmm…looks like the erratum needs an erratum because the original X-axis is back.
Why did he recently re-post the original slide? One of two reasons:
- In a fit of conscience, he realized his new lies were wrong and replaced them with his old lies;
- The people he worked with at Eastman Chemical and HFC were told by someone — I don’t know who and shame on them! — that he had doctored the original. They insisted on changing it back because indeed the program did not start until 2006.
Either way, we look forward to hearing Ron’s rebuttal. After all, this blog posting isn’t going to rebut itself.
it’s rare that we use this blog to simply point you to something that:
- we had nothing to do with,
- is better than anything we could have come up with…
…but we’re doing exactly that today. This is the best explanation of airborne COVID transmission I’ve ever seen. Special thanks to Dr. Anthony Pearson of The Skeptical Cardiologist for bringing it to our attention.
Think of smoke as COVID viruses. Just like smoke is suspended in the air, so are virus particles. In both cases, there is no magic in being 6 feet from the source. The 6-foot distancing rule is more like an “80-20 rule” of distancing. It’s not an invisible barrier.
If one person smokes in a bar, basically everyone in the bar can smell a little smoke. Obviously, the patrons sitting closer to the smoker smell more. Likewise with one COVID superspreader in an indoor space.
Outdoor spaces are different. Someone can smoke downwind from you or X number of feet away with no wind…and you won’t even notice. But you don’t want to be surrounded by smokers or upwind from them.
Connect here to go the The Conversation and read the entire analogy. And why we think it’s the best way to describe COVID transmission.
Fortunately, Quizzify has question sets addressing this exact topic. So contact firstname.lastname@example.org today to see how you can get access.