Why we read the papers ourselves: a flagship journal, one scatter plot, and the difference

This site quotes scientific papers about cannabis, and you should want to know what a paper's appearance here means. Here is our policy in one sentence: peer review is a signal, not a certification. A journal's acceptance tells us a paper might be worth our attention, and nothing more. Before we cite anything, our staff reads the full text, checks the methods against the claim we want to rest on it, records the funding and the conflicts, and asks what a hostile expert would attack first. When a paper fails that read, we say so plainly, by name.

That policy costs us time, and it needs justifying. So this page shows you, on one worked example, why "it passed peer review at a top journal" is not the assurance it sounds like. The example has nothing to do with cannabis, which is the point. The failure we're about to show you is structural, and once you've seen it here, you'll recognize it when we point at the cannabis literature.

The paper

From the published record

In July 2026, Psychological Review (the American Psychological Association's flagship theory journal, publishing since 1894) put out "Talking the Talk, Not Walking the Walk: The Coevolution of Overconfidence and Loss Aversion" by Chris Dawson (Bath) and David de Meza (London School of Economics). The acknowledgments thank some of the most famous names in the field, including Daniel Kahneman and Steven Pinker. This is as prestigious as publication gets in the behavioral sciences.

The theory is genuinely interesting: that overconfidence isn't a bug but a credible signal. Believing your own exaggerations is costly, and the cost is smaller for the genuinely able, so confidence honestly (if inflatedly) advertises ability, while hidden loss aversion evolved alongside it to quietly limit the damage. Big, elegant idea. We take no position on it here.

Our subject is the paper's evidence.

The evidence, in plain language

Editor's analysis: the numbers are the paper's own

The paper's empirical support comes from an existing dataset: about 4,000 people on Amazon's Mechanical Turk (a website where people do small tasks for small payments) answered 20 grammar questions and 20 logic questions, then guessed their own scores. The paper's claim: what people expected of themselves predicted how they actually did, the way the signaling theory needs.

Now the three things the paper's own numbers say:

First: the "prediction" is nearly no prediction at all. The fitted slopes are 0.25 for grammar and 0.18 for logic: in variance terms, self-expectations explain roughly eight percent of grammar performance and four percent of logic performance. Ninety-two to ninety-six percent of what the theory needs explained is noise from the theory's point of view. Picture the scatter plot: a shapeless cloud with a faint lean.

Second: the confidence was free. Participants' guesses about their own scores cost them nothing. The study the data comes from paid nothing for accuracy, and the paper says so itself: "Forecast accuracy was not incentivized." The theory being tested is a theory of costly signals: confidence is credible because being wrong hurts. The evidence offered for it is a stack of guesses where being wrong was free. That's cheap talk offered as evidence for a costly-talk theory.

Third, and this is the one that should stop you: one of the paper's headline numbers is an arithmetic identity. As "complementary evidence," the paper reports symmetric regression slopes of 1.15 (grammar) and 1.13 (logic), being above one "as the signaling model predicts." A symmetric (reduced major axis) slope is computed as the ratio of the two standard deviations. The grammar data's standard deviations are 3.91 and 3.40. Divide them: 1.15, exactly. The logic data's: 4.05 and 3.59. Divide: 1.13, exactly. Those slopes would come out identical if every person's guess had been random noise with no connection to their score at all. The number cannot support the theory, because the number would appear whether or not the theory were true.

One scatter plot

Editor's analysis

None of the above requires a psychology degree. It requires looking at the data before fitting lines to it. The physicist Sabine Hossenfelder reviewed a reanalysis built on this same dataset (the same guess-your-score data, the same regression moves) in public, on camera, for a lay audience. Her method: put up the scatter plot. Her conclusion, verbatim: "Just look at the data. It basically doesn't have any correlation whatsoever. Why the hell are you fitting any straight line to this?" She rated the line-fitting enterprise, that paper and its predecessors, ten out of ten on her bullshit meter.

A flagship journal's expert referees passed what one outside-field physicist dispatched with a single plot. That is not because the referees were fools. It is because in-field reviewers cannot see flaws that are their own field's standard practice. Fitting lines through weak-correlation clouds and reporting the slope as a finding is normal in that literature, so nobody in the room flagged it. Peer review checks whether a paper is shaped like the field's science. It does not check whether the claim is true.

What happens now, under this site's rules: this paper is never cited as evidence on this site. Its role here is the one on this page, review subject. And this page is the letter of concern: published, checkable, addressed to readers rather than to a journal's correspondence file. The central defect is arithmetic: anyone, including the authors, can verify it from the paper's own table in under a minute.

What this has to do with cannabis

Editor's analysis

Everything. Our entourage effect guide shows a cannabis research literature where studies routinely fail to report what plant material they administered, at what dose, chosen how: flaws that would be disqualifying for any other drug, passing peer review as normal. Same structural failure: a field's conventions make its own blind spots invisible to its own referees. Cannabis research normalized uncharacterized material the way behavioral science normalized line fits through noise. In both cases the journals' stamp certifies conformity to the field's habits, including the bad ones.

That is why this site does not treat "peer-reviewed" as meaning "evidence," in either direction: for cannabis claims or against them. And it is why, when we cite a paper, our ledger shows you the desk-review date, the verdict, the numbers, the funding, and the conflicts. We are not asking you to trust the journals. We are not asking you to trust us either. We show the numbers so you can check.

What appearing on this site means

• Cited with a desk review: we read the full text, and the claim we rest on it survived the hostile-reviewer question. The fences travel with the citation.
• Reviewed and found wanting (like the paper above): named, quoted, and shown, with the numbers, so you can verify our verdict yourself. A defective paper is a reason to say more about it, not less.
• Never: a paper as a decoration, cited because its abstract agrees with us.