Annotations by Astra 6 Pro. Open annotated chapter · Original at reviewed revision
An elegant self-experiment does not establish a general treatment effect
Shangri-La Diet per se
A personal dietary result can generate a hypothesis while leaving confounding, adherence and generalizability unresolved. The essay admits that a method may fail for a particular reader, which is appropriate. It still needs controlled evidence for the proposed mechanism and the practical prediction; a deeper story alone does not supply it.
Mechanistic understanding can improve a prediction, if it earns its place
without the explicit theory backing it up.
A theory that correctly predicts when a technique works and fails can improve generalization. A story added after the outcome can explain anything and predict little. The useful test is a new, risky prediction checked against data, including unsuccessful cases and competing explanations.
A memory effect cannot be transferred to meal advice without a test
the Peak–end rule
The classic better-ending experiment concerned cold-water discomfort and later preference between episodes. It does not establish that reducing a meal’s size leaves its remembered pleasure unchanged or that dessert is the only relevant variable. The dietary prescription needs a direct test of the actual outcome being promised.
Kahneman et al. (1993)
The confident appeal to ego depletion aged badly
willpower, mental conflicts, ego depletion, preference reversals,
Hagger et al.’s preregistered 23-lab test found d=0.04, 95% CI [−0.07, 0.15], with 2,141 participants. Vohs et al.’s later 36-lab study found a nonsignificant confirmatory d=0.06 with 3,531 participants. These results substantially weaken reliance on a large, dependable depletion effect as an established foundation for advice.
Hagger et al. (2016); Vohs et al. (2021)
The correction is not that fatigue or every depletion effect is imaginary
a vocabulary of cognitive phenomena that actually exist
A separate preregistered 12-lab study by Dang and colleagues found a small effect, d=0.10, with 1,775 participants. The evidence is heterogeneous, and even a reliable sequential-task effect would not uniquely establish a literal resource tank. The warranted update concerns effect size, generality and mechanism; it does not license an equally sweeping denial.
Dang et al. (2021; online 2020)
A small p-value is not a replication certificate
reported p < 0.01 because p <
The ASA statement rejects treating significance as a universal quality threshold. For illustration, if only 1% of tested hypotheses are real, power is 80% and the false-positive rate is 1%, only about 45% of significant results would be true positives even before selective reporting. These are stipulated numbers, not an estimate for this literature; they show why the threshold alone cannot do the promised work.
Wasserstein & Lazar / ASA (2016)