Wellsteps
Short Summary of Intervention:
“At Wellsteps, we’ve created a series of research-based ROI calculators to help you estimate the effect of well-designed wellness programs on health care costs, absenteeism, and presenteeism. Each of the three ROI calculators will examine a different employee expense and will help you determine whether investing in wellness strategies makes sense for your company. A well-designed wellness program is one that changes the health behaviors of employees, spouses, and dependents, and lowers health risks, reduces chronic disease, and helps worksites create a culture of health. The design of the WellSteps turnkey wellness solution was based partly on this body of evidence.”
Materials Being Reviewed:
Wellsteps ROI Calculator . You input your number of employees, health spending, and goals for obesity and smoking cessation. The calculator will tell you how much money you can save through the Wellsteps program.
Summary of key figures and outcomes:
Questions for Wellsteps:
In the first example above, your model calculated massive savings even with no change in obesity and smoking. In the second example, your model calculated the same massive savings even with a huge increase in obesity and smoking. It seems that no matter what smoking and obesity data we enter once we factor out inflation itself, your ROI calculator reduces healthcare costs to a level below zero by 2019. How is this possible?
ANS: Refused to answer
Shouldn’t a spike in smoking and obesity rates from 0% to 99% increase healthcare spending rather than reduce it?
ANS: Refused to answer
Your May 2014 email blast, sent out a few days after The Health Care Blog exposed your ROI model as being invalid, says your model is supported by “every wellness ROI study ever published” (a step up from being “research-based” on a “body of evidence” as your website says). We recognize that asking you to list “every wellness ROI study ever published” would be burdensome, but could you direct us to just one study that says increasing smoking and obesity can improve workforce health and/or reduce healthcare costs to below zero?
ANS: Refused to answer
Does “every wellness ROI study ever published” include the RAND studies in Health Affairs that have found negative ROIs?
ANS: Refused to answer
How are you able to “guarantee” this ROI, since it is impossible to reduce spending to a negative number?
ANS: Refused to answer
Since you’ve known that the Wellsteps ROI Calculator is invalid since this fact was pointed out to you in October 2013 and you have updated your model twice since then, how come you have elected to continue to overstate savings by a mathematically impossible figure?
ANS: Refused to answer
You lead your marketing blast by saying that “11,000 brokers and consultants” have used this ROI model? Are we the first of those 11,000 people to observe negative savings?
ANS: Refused to answer
Do you see any irony in publicly accusing one of the principals of this website, Al Lewis, of acting like a “tobacco executive lying to Congress” when even tobacco executives wouldn’t claim that smoking reduces healthcare costs like your model says it does?
ANS: Refused to answer
Where in your “ROI Calculator” can I find the ROI?
ANS: Their ROI Calculator doesn’t calculate an ROI so there was no point in even asking them to answer this question. The good news about Wellsteps is that NASA employees don’t have to worry about job security because these people are not rocket scientists.
Update: July 16, 2014
Addendum: Wellsteps accusation that I “entered false data” into the ROI calculator was posted on the “Wellness Is a Business Strategy” Linkedin Group
“It has come to our attention that an outspoken critic has entered false data into these calculators in order to make a point. We certainly support free speech; however, we wonder how valid the point can be when it is based on false data?”
“Use valid estimates for the percent of the current obese and smokers in an employee population. We provide the estimated default numbers based on national data of 33% and 20% respectively in all three calculators. In our combined 50 years of academic and consulting work, we cannot think of one employer with a 0% obesity AND 0% smoking rate. Again, valid estimates work best.”
Actually, we ran every combination of data from a reduction of 99% in smoking and obesity rates to an increase of 99% in smoking and obesity rates. Some of that data might have been “false” (whatever that means), but the result was always the same: $1358.85 in savings/employee by 2019. Here are two more examples, this time using the default numbers they recommended. The first is @$5000/employee in annual costs, with no change in smoking or obesity. The second is @50,000/employee. The answer is still the same.
How come, regardless of what assumptions get entered (and we have now entered many vastly different combinations of cost and success), the answer is always that by 2019, you save $1,358.85 per employee once you zero out inflation?
ANS: Refused to answer
Would you now admit that entering $5000/employee in spending and 33% obesity and 20% smoking (the national averages) constitute, in your words, “valid estimates that work best” ?
ANS: Refused to answer
Following my exposé, your model no longer allows a user to enter increases in smoking and obesity. Is this to prevent users from figuring out that even if the rates of smoking and obesity increase, the math underlying your model based on “every ROI study ever published” will still show a reduction of $1,358.85/employee in 2019?
ANS: Refused to answer
How come the model shows that very same $1358.85 (now finally “rounded” to $1359) potential savings from reducing obesity and smoking even if I start out with no smokers or obese employees?
Update–May 1, 2015: Wellsteps Doubles Down on Dishonesty
Two people forwarded us this, a sequel to their email that their ROI model is “based on every ROI study ever published”:
Update–September 10, 2015: Wellsteps Triples Down on Dishonesty
Somehow they reported costs going up and down at the same time. Even wellness industry math doesn’t allow that.
[…] 1: Steve Aldana, Wellsteps. In defending his wellness “ROI Calculator” that shows the potential for a company to achieve […]
LikeLike
Thanks for posting this to the HR forum. We were seriously looking at this vendor, I’m embarrassed to say. You saved us a lot of trouble down the road.
LikeLike
I might also consider replacing the broker or consultant who is “representing” you since — while for you to make this mistake is understandable because analytics isn’t your job — for your advisor to make this mistake is unacceptable.
LikeLike
So I had the Wellsteps ROI calculator foisted upon me in class today as a great tool for wellness practitioner. I responded with as much information as I could recall from this post and then sent a link to the professor. This should get interesting. Thanks for providing evidence-based rebuttals to the things that everyone preaches is correct simply because of the source/owner (wellsteps).
LikeLike
It’s mind-boggling that Wellsteps knows it’s made up, they’ve been caught, anyone can see it’s made up…and yet what you describe happens routinely.
LikeLike
[…] And no wonder Wellsteps was screening the stuffing out of these people, far in excess of guidelines, and encouraging unneeded annual checkups. This conclusion that is reached without even taking into account the likelihood of employees lying on HRAs, cheating during the weigh-ins, or Wellsteps putting their fingers on the scale in the measurements above (“adjusted for age and sex”) as they are wont to do. […]
LikeLike