Bayesian Shangri-La Diet

In July, a Cambridge UK programmer named John Aspden wanted to lose weight. He had already lost weight via a low-carb (no potatoes, rice, bread, pasta, fruit juice) diet. That was no longer an option. He came across the Shangri-La Diet. It seemed crazy but people he respected took it seriously so he tried it.  It worked. His waist shrank by four belt notches in four months. With no deprivation at all.

Before he started, he estimated the odds (i.e., his belief) of three different outcomes predicted by three different theories. What  would happen if he drank 300 calories (2 tablespoons) per day of unflavored olive oil (Sainsbury’s Mild Olive Oil)? Aspden considered the predictions of three theories.

I called my three ideas of what would happen [= three theories that make different predictions] if I started eating extra oil Willpower, Helplessness and Shangri-La. (1) Willpower (W) is the conventional wisdom. If you eat an extra 300 calories a day you should get fatter. This was the almost unanimous prediction of my friends. Your appetite shouldn’t be affected. (2) Helplessness (H) was my own best guess. If you eat more, it will reduce your appetite and so you’ll eat less at other times to compensate, and so your weight won’t move. Whether this appetite loss would be consciously noticeable I couldn’t guess. This was my own best guess. (3) Shangri-La (S) is your theory. The oil will drop the set point for some reason, and as a result, you should see a very noticeable loss of appetite.

More about these theories. His original estimate of the likelihood of each prediction being true: W 39%, H 60%, S 1%. He added later, “I think I was being generous with the 1%”. After the prediction of the S theory turned out to be true, the S theory became 50 times more plausible, Aspden decided.

I like this a lot. Partly because of the quantification. If you were a high jumper in a world without exact measurement, people could only say stuff like “you jumped very high.” It would be more satisfying to have a more precise metric of accomplishment. It is a scientist’s dream of making an unlikely prediction that turns out to be true. The more unlikely, the more progress you have made. Here is quantification of what I accomplished. Although Aspden could find dozens of online reports that following the diet caused weight loss, he still believed that outcome very unlikely. Given that (a) the obesity epidemic has lasted 30-odd years and (b) people hate being fat, you might think that conventional wisdom about weight control should be assigned a very low probability of being correct.

I also like this because it is the essence of science: choosing between theories (including no theory) based on predictions. The more unlikely the outcome, the more you learn. You’d never know this from 99.99% of scientific papers, which say nothing about how unlikely the actual outcome was a priori — at least, nothing numerical. I can’t say why this happens (why an incomplete inferential logic, centered on p values, remains standard), but it has the effect of making good work less distinguishable from poor work. Maybe within the next ten years, a wise journal editor will begin to require both sorts of logic (Bayesian and p value). You need both. In Aspden’s case, the p value — which would indicate the clarity of the belt-tightening — was surely very large. This helped Aspden focus on the Bayesian aspect — the change in belief. This example shows how much you lose by ignoring the Bayesian aspect, as practically all papers do. In this case, you lose a lot. Anyone paying attention understands that the conventional wisdom about weight control must be wrong. Here is guidance towards a better theory. If not mine, you at least want a theory that predicts this result.

 

 

 

 

 

7 Responses to “Bayesian Shangri-La Diet”

  1. Tuck Says:

    “I can’t say why this happens (why an incomplete inferential logic, centered on p values, remains standard), but it has the effect of making good work less distinguishable from poor work.”

    I think you just answered your own question.

    There’s a whole industry of academies, scientists working at those academies, and journals those scientists publish in to advance at their acadamies that depends on good work being less distinguishable from poor work.

    A better standard might reveal that a lot of those scientists aren’t doing valuable work…

    Seth: Why would a journal editor care about protecting them? My favored explanation is inertia.

  2. jimrandomh Says:

    One of my preferred theories (not mentioned here) is regression to the mean: diet is part of a very complicated system, and making a big change to your diet is akin to taking a reroll; if your health is below average it has a good chance of being an improvement, simply by regression to the mean. Shangri-La is unusual in that it has a high change-size-to-effort ratio (10+% of calories without needing to learn any recipes or discard any foods).

  3. Kayode Says:

    Seth,
    Any good books on understanding p values, bayesian probability and how its used in scientific research? I have a hard time grasping these concepts.

    Seth: John Kruschke’s book: http://www.indiana.edu/~kruschke/DoingBayesianDataAnalysis/

  4. random_process Says:

    Seth,

    I tried the Shangri-la diet but not rigorously enough. I wanted to make another go at it since the other diets that work (like low carb) are proving too hard for me.

    I tried with flax seed oil and nose clipping but there was always a after taste. I like flax seed oil but fear that the it was not flavorless enough to qualify.

    Will taking fish-oil capsules satisfy as “taste less calories” instead of extra-light olive oil?

    thanks for your blog – it is a trove of ideas!
    :)

    Seth: Yes, capsules = smell-less calories. However, you have to take a lot of capsules/day (about 30, too many, in my opinion) to get enough calories. You might try rinsing your mouth with water after nose-clipping flaxseed oil.

  5. Alex Chernavsky Says:

    I bought a noseclip used by swimmers, but it wasn’t tight enough, and I could still taste whatever I was consuming. I now pinch my nose shut with my hand when I take coconut fat, and I drink four or five mouthfuls of warm water (after sloshing it around my mouth first). When I drink flaxseed oil, I don’t pinch my nose. Perhaps I should — maybe I’d lose more weight if I did.

    Seth: Some of the noseclips I’ve used are adjustable. Some aren’t.

  6. Scott Pierce Says:

    I read the book when it came out and followed it for a short while but here recently I realized that I had been following the protocol unwittingly. I had been taking MCT oil to drive up my ketone levels. It is almost completely flavorless and has other benefits as well if anyone wants to give it a try. I recommend the Now brand easily found on amazon.

    Seth: Since you started the MCT oil (how long ago?), has your weight changed?

  7. Paul N Says:

    For another view on the bayesian approach, check out this XKCD take on it;
    http://xkcd.com/1132/