2021 Update — we aren’t just “outing” the worst. Instead we are claiming to be the best: The reward now applies to any behavior-change vendor — diabetes, wellness etc. — vs. Quizzify. $3 million is yours if found by the 5 judges (and remember, we only appoint one!) to be more cost-effective than Quizzify.
Here are the specific rules to claim the reward.
Almost any behavior-change vendor (e.g., Virgin Pulse, Bravo, Accolade, Livongo) is eligible to claim the reward. A “behavior change” vendor would be one whose value depends on employees doing something voluntarily or with an incentive/penalty, paid via an admin fee. Eligible categories include wellness, diabetes, weight loss, mental health, sleep, coaching, EAPs, “challenges” programs, fitness, nutrition, navigation, patient-centered medical homes, and price-shopping companies.
We say “almost any” because behavior change vendors that we work with are ineligible because we help them dramatically increase engagement. For instance, Sera Prognostics enhances its guarantee if Quizzify is also used, and we enhance ours.
If indeed a vendor considers itself to be a behavior change company and Quizzify looks at it and says, no, this is not behavior change, the vendor may announce that Quizzify rejected their application. The vendor may then apply to the Validation Institute to arbitrate whether it is a behavior change company or not. If it wins, Quizzify agrees to pay for its validation.
Selection of Judges
There will be five judges, selected as follows:
- Each side gets to appoint one, drawn from The Healthcare Hackers listserve with more 1000 people on it, from all walks of healthcare.
- Two are appointed objectively. That will be whichever health services researchers/health economists are the most influential at the time the reward is claimed. “Most influential” will be measured by a formula: the highest ratio of Twitter followers/Twitter following, with a minimum of 15,000 followers.
- Those four judges will agree on the fifth.
Using the criteria below, the judging will be based largely on value per dollar of the program spent on the program and incentives. In the event this is considered to be roughly a tie, the judges will consider the validity of their measurement and whether they are validated by the Validation Institute.
Each side submits up to 2,000 words and five graphs, supported by as many as 20 links; the material linked must pre-date this posting to discourage either side from creating linked material specifically for this contest.
Publicly available materials from the lay media or blogs may be used, as well as from any of the 10 academic journals with the highest “impact factors,” such as Health Affairs, published within the last ten years.
Each side must:
- list their average prices per employee per year
- speak to compliance with ACA, ADA, USPSTF, and Choosing Wisely;
- allow the other to test its materials (for example, taking the health risk assessment) and review them as part of the submission.
Each party may separately cite previous invalidating mistakes made by the other party that might speak to the credibility of the other party. (There is no limit on those.)
The judges may rule just on the basis of the written submissions. If not, the parties will convene online for a 2.5-hour presentation (or, at the discretion of the judges, in-person at the World Health Care Congress), featuring:
- 10-minute opening statements, in which as many as 10 slides are allowed;
- 30-minute cross-examinations with follow-up questions and no limitations on subject matter;
- 60 minutes in which judges control the agenda and may ask questions of either party based on either the oral or the written submissions;
- Five-minute closing statements.
The entry process is:
- Applicant puts $3000 into escrow, at which point an NDA is signed and Quizzify/Quizzify guarantors (“Quizzify”) demonstrate liquid assets exceeding $3 million. Applicant may either go forward at this point, or forfeit the $3000.
- Applicant adds $27,000, at which point earning assets exceeding $3,000,000 are placed in escrow, though the income from the escrow does not go to the applicant. Assuming the $3,000,000 is sufficiently secured, applicant may either go forward, or forfeit the $30,000. If not secured, Quizzify pays the applicant $100,000.
- Applicant adds $270,000 to the escrow within 30 days, at which point the entry process is completed. Both sides then have 30 days to submit materials and 7 days to rebut. Online argument then takes place, if needed.
- Judges are paid from the escrow, 50-50 from Quizzify’s and applicant’s shares.
- If the applicant pulls out after publicly announcing he or she is applying and before adding the $270,000, there is a $50,000 liquidated damages fee, tripled if it has to be procured through litigation. If Quizzify pull outs, there is a $150,000 liquidated damages fee in favor of the applicant, tripled if it is procured through litigation.
- The winner collects the escrow.
June 2021 Update: Virgin Pulse’s one-page outcomes report is eligible. They can win just by defending one single slide with as much backup as they want.
March 2021 Update: Wellsteps can claim double the reward ($6 million) for half the entry fee ($150,000) simply by showing that their ROI calculator is more accurate than Quizzify’s.
January 2021 Update: Omada is claiming outcomes on their home page that are textbook examples of both regression to the mean and participant bias. They are aware this is not valid. They can claim this reward by defending their specious claims.
December 2020 Update: This reward is now applicable to any actuary or other self-proclaimed expert who claims that their published analyses of the wellness/diabetes/disease management industries showing favorable outcomes and savings are better than mine showing losses and general cluelessness.
Here is the original offer and how it is changed.
As almost everyone in the wellness industry knows, we have offered a $2 million reward to anyone who can show that conventional annual “pry, poke and prod” wellness saves money. I’m feeling very generous today, what with the holidays upon us, so let’s make the reward $3 million.
Even more importantly, let’s loosen the rules — a lot — to encourage applicants. You’ll find the $3 million reward is not just more generous, but also far easier to claim than the previous $2 million reward.
Special Offer for HERO
Ah, yes, the Health Enhancement Research Organization (HERO). The belly of the beast.
Let me make them a special offer. Paul Terry, the current HERO Prevaricator-in-Chief, has accused me of the following (if you link, you’ll see they had enough sense not to use my name, likely on advice of counsel, given that I already almost sued them after they circulated their poison pen letter to the media):
I’m convinced responding to bloggers who show disdain for our field is an utter waste of time. I’ve rarely been persuaded to respond to bloggers [Editors note, in HERO-speak, “rarely” means “never” — except for that intercepted Zimmerman Telegram-like missive], and each time I did it affirmed my worry that, more than a waste, it’s counter-productive. That’s because they’ll not only incessantly recycle their original misstatements, but worse, they’ll misrepresent your response and use it as fodder for more disinformation.*
Tell ya what, Paul. let’s debate disinformation, including your letter.
I have asked you on multiple occasions to clue me in as to what my alleged disinformation actually is, if any. That way I can publicly apologize and fix it, should I choose to do so. Before applying for this award, you need to disclose this alleged disinformation. You can’t just go around saying my information is made up etc. without specifying what it is.
By definition, “disinformation” is deliberate misrepresentation. To my knowledge, as a member of the “integrity segment” of the wellness industry, I have never, and would never, spread disinformation.
On the other hand, if I did spread inadvertently incorrect information by mistake, it seems only fair to let me fix it — especially given that I have been totally transparent and generous with my time in explaining to you what yours is, and how to correct it. (I might have missed some. Keeping up with yours is a challenge of Whack a Mole-meets-White House press correspondent proportions.)
So perhaps it is time to man up, Mr. Terry. You and your cronies claim to have been collecting my “disinformation” for years, without disclosing any of it. I’m offering you a public forum and $3-million to present it…with only one of 5 judges on “my” side.
Otherwise, perhaps you should, in the immortal word(s) of the great philosopher Moe Howard, shaddap.
*As a side note, Mr. Terry writes: “We’re fortunate to work in an industry with a scant number of vociferous critics.” This “scant” number appears to include the entire media — left-wing, right-wing, centrist, and health policy. Apparently also most employees, according to Towers Watson. The good news about “pry, poke and prod” is that it truly bridges the partisan divide, in that everyone hates it.