They Said What?

Home » 2023 » November

Monthly Archives: November 2023

Official Rules for Acacia $100,000 Validity/Outcomes Challenge

Congratulations to Acacia Clinics for achieving the highest level of validation from the Validation Institute. That comes with a $50,000 Credibility Guarantee.

In rare cases, such as Virta Health or Sera Prognostics or Ault International Medical Management, I add my own guarantee.

Any mental health vendor (I’m lookin’ at you, Lyra) can challenge my statement that Acacia has the most validly measured good outcomes. Here are the terms to earn the $100,000.


Terms and Conditions of Challenge

Selection of Judges

There will be five judges, selected as follows:

  • Each side gets to appoint one, drawn from Brian Klepper’s listserve with 1000 people on it, from all walks of healthcare.
  • Two others are appointed objectively. That will be whichever health services researchers/health economists are the most influential at the time the reward is claimed. “Most influential” will be measured by a formula: the highest ratio of Twitter followers/Twitter following, with a minimum of 15,000 followers.
  • Those four judges will agree on the fifth.

Using the criteria below, judging will be based on validity of the measurement. Measurements deemed invalid, such as those described on the Validation Institute site, is a disqualifying factor, i.e., any challenge by a vendor that is not validated by the Validation Institute.

If the challenging party/vendor is deemed by the judges to have an equally valid metric as Client, the decision is made on the impact of the program in outcomes for people with treatment-resistant OCD.


Written submissions

Each side submits up to 2,000 words and five graphs, supported by as many as 20 links; the material linked must pre-date this posting to discourage either side from creating linked material specifically for this contest.

Publicly available materials from the lay media or blogs or the Validation Institute may be used, as well as from any academic journal that is not open-access.

Each party may separately cite previous invalidating mistakes made by the other party that might speak to the credibility of the other party. (There is no limit on those.)


Oral arguments

The judges may rule solely on the basis of the written submissions. If not, the parties will convene online for a 2.5-hour recorded virtual presentation featuring 10-minute opening statements, in which as many as 10 slides are allowed. Time limits are:

  • 30-minute cross-examinations with follow-up questions and no limitations on subject matter;
  • 60 minutes in which judges control the agenda and may ask questions of either party based on either the oral or the written submissions;
  • Five-minute closing statements.

Entry process

The entry process is:

  1. Challenger and TheySaidWhat deposit into escrow the amount each is at risk for ($100k for the Challenger, and $100k for TheySaidWhat). Each party forwards $10,000 to the judges as well, as an estimate of their combined fees and/or contributions to their designated nonprofits.
  2. If the Challenger or Service Provider pulls out after publicly announcing an application, the fee is three times the amount deposited.
  3. The escrow is distributed to the winner and the judges’ fees paid by the winner are returned by the judges to the winner, while the judges keep the losers’ fees.

Other

The competition is open to any mental health vendor outcomes claim which was made before November 7, 2023. This date may be updated by TSW from time to time.