I mean to be doing a lot of thinking about probability theory, Bayesianism, etc. over the course of the next few months, perhaps longer. And I’ll be blogging it. Thus begins a (probably irregular) series of posts that I’m going to dub “Bayes blogging,” because it sounds better than “probability blogging.”
To start off with, I’m going to review Richard Carrier’s Proving History. This review is long overdue. I first read the book near the beginning of last year, but am only now reviewing it as part of a commitment to blogging more about these issues.
As you may know, Proving History is the first book in a two-book series arguing that Jesus never existed. This first book, though, is primarily about methodology, and that’s what I’m going to be caring about here. In fact, I read it precisely because I’d heard it strongly recommended on those grounds by Luke Muehlhauser.
I want to start off by saying that Carrier may be right about everything he really needs for the larger project on the historicity of Jesus, namely that Bayes’ theorem is potentially quite useful to historians and if an argument is clearly nonsensical on Bayesian terms it should be discarded. But I’m not going to be talking about those kind of Bayesian basics in this review. If you need that, I recommend Eliezer Yudkowsky’s “An Intuitive Explanation of Bayes’ Theorem.”
Instead, I’m going to be focusing on the philosophical side of the book. This is clearly an important part of the book–from an e-mail exchange I had with Carrier:
You say, “An example of resolving philosophical questions with Bayes’ Theorem is my chapter ‘Neither Life Nor the Universe Appear Intelligently Designed’,” what would be the equivalent statement about Proving History? Would you say it’s an example of how to resolve an analytical debate (about the historical method and epistemology)?
Oh, yes. Proving History is itself a work in the philosophy of history, covering the logic, epistemology and semantics of historical argument. And in that respect it is an example or model that might be useful to consult if anyone wants to expand the approach to other subject fields in philosophy.
Also, I recognize much of the material in Proving History, was focused on historical method, but chapter 6, “The Hard Stuff,” goes pretty far into general philosophical debates, how would you describe that chapter?
Yes, that’s true. Because I wanted the book to be as approachable to humanities majors as possible, I put all the most complex and difficult stuff I could in the last chapter so people who have no worries about those issues can skip it, while those who want those concerns resolved can dive in. It’s aim is to shore up issues that needed to be resolved for the rest of the book, and thus most of its examples still come from and deal with history. But of course many of those issues would similarly be raised if Bayes’ Theorem were applied to any other subject field in philosophy, so it does have a broader utility. Although again I’d say mostly indirectly, as my concern throughout was with answering historians and philosophers of history specifically. Other subjects were not as much on my radar. But inevitably the questions and applications dealt with there are often the same in any field.
So, let’s look at the philosophy: A key part of Carrier’s thesis is that even when it may not seem like we’re talking about probability, we actually are. For example, on p. 24, he says:
when we say something is “probable,” we usually mean it has an epistemic probability much greater than 50%, and if we say it’s “improbable,” we usually mean it has an epistemic probability much less than 50%.
Similarly, on p. 50:
Every time we say something is “implausible” or “unlikely,” for example, we are covertly making a mathematical statement of probability (and if this is not already obvious, I will prove it in the next chapter, beginning on page 110).
For those who would say we sometimes have no idea what probability to assign to a claim, Carrier endorses the principle of indifference. On p. 81:
Another key part of Carrier’s thesis is that all valid historical reasoning can be captured in Bayesian terms. He writes (on p. 104 and 106):
In fact, any valid form of hypothetico-deductive method is described by BT…. Bayes’s Theorem models and describes all valid historical methods… All become logically valid only insofar as they conform to BT.
Even if these claims are plausible, the way Carrier argues for them often ends up being problematic. He talks of “proving” his claims, and says things like, “I shall establish this conclusion by formal logic” (again on p. 106), as if he could derive them through the mathematical certainty of Bayes’ theorem itself. The trouble is that he seems not to clearly distinguish between Bayes’ theorem on the one hand, and Bayesian methodologies and philosophical claims on the other.
For example, on p. 81 Carrier writes:
The objection most frequently voiced against BT [Bayes’ Theorem] is the fact that it depends on subjectively assigned prior probabilities and therefore fails to represent objective reasoning.
This makes the views of the critics sound silly, as Bayes is a piece of mathematics, which you shouldn’t reject for those kinds of reasons. You might, however, reject certain philosophical claims about Bayes for those reasons. This suggests not just a failure to distinguish between different kinds of claims, but also that Carrier doesn’t understand the views of people who might object to his project.
Similarly, starting on p. 106, Carrier spends a fair amount of breath saying how no valid argument or method can contradict Bayes’ theorem. This may be technically true, but it’s unclear whether this gets Carrier as much as he would like. Bayes’ theorem, again, just tells you what to do once you have certain probabilities (which it’s not clear we can always get), while historical methods and arguments often don’t explicitly deal with probability.
Of course, Carrier would claim that the outcome of any historical argument is always implicitly probabilistic. And he promised to “prove” it starting on p. 110. It turns out that a key part of the argument here is to refer the reader back to his previous discussion of a fortiori reasoning. From p. 85:
There are several tricks to ensure your use of BT is adequately objective. The most important is employing estimates of probability that are as far against your conclusion as you can reasonably believe them to be. This is called arguing a fortiori, which means “from the stronger,” as in “if my conclusion follows from even these premises, then my conclusion follows a fortiori,” because if you replaced those estimates with ones even more correct (estimates closer to what you think the values really are), your conclusion will be even more certain.
Carrier claims that this approach can solve the problem of not knowing exactly what numbers to plug in to Bayes’ theorem to get a result. In a way, it’s a very good point, which goes a lot way to making Bayes’ theorem practically useful to historians. But I’m skeptical that it goes all the way to showing that all valid historical reasoning can be captured in Bayesian terms.
To see why I hesitate, here, it can be worth reflecting on just how difficult it is to assign probabilities to historical claims sometimes. Consider an example Carrier an I have both spent a lot of time talking about, the claims of Christian apologists about Jesus’ resurrection.
When I need to explain why the apologists’ arguments are no good, the first thing I’m going to do is go to examples like the story of Joseph Smith and the Book of Mormon, or if I want the analogy to be exact as possible use a hypothetical example like Carrier’s Hero Savior of Vietnam example.
If it turns out that they’re the type of person that thinks maybe Joseph Smith was demonically influenced, I can lecture them a bit about the history of paranormal investigation, the troubles the Society for Psychical Research ran into, and so on. But assuming they agree that they acknowledge that they don’t/wouldn’t accept those other claims, I can then argue that the evidence for Jesus’ alleged resurrection is no better so they should accept that claim either.
Now you can put a Bayesian gloss on all this, and say that the prior improbability of a miracle is too low for the meager evidence presented by the apologists to overcome it. But it’s hard to know where to begin saying where those probabilities are exactly, even a fortiori.
It’s wildly inadequate to merely say they’re “low,” because as William Lane Craig points out, we have no trouble believing reports of lottery numbers being picked when a given number only had a one in a million chance of being picked. So, if you accept the argument from the analogy of Joseph Smith and Hero Savior, we know the probability needs to be really low. But how low is that? It’s hard to say.
The most I really think we can do here is give the argument from analogy, and then argue that what we’ve done can be made sense of in Bayesian terms. But that doesn’t necessarily mean we could get the right conclusion using Bayes alone, with no sanity checks from things like the argument by analogy to make sure the numbers we were plugging in to Bayes’ theorem made sense.
Or maybe we can go purely Bayesian if we’re careful enough… but what Carrier says in the sections of the book where he purports to “prove” his philosophical claims don’t actually seem to prove this.
This post is already quite long, and I haven’t even touched the chapter on “The Hard Stuff,” the most philosophically dense chapter of the book. So let me end this post here, and I’ll come back to that chapter in part 2.