Bayes' Rules is central to modern economics and modern psychology. According to Bayes' Rule, a rational person starts with some beliefs about probabilities (his "priors") and changes them in a particular way as new information arrives, in order to reach new beliefs (his "posteriors"). Psychologists usually emphasize that people should use Bayes' Rule; economists are more likely to assume that people do use Bayes' Rule.
The main problem with Bayes' Rule is that it doesn't say where priors come from, or which ones you should have. It is tempting to say that every prior is just your last posterior. But where did your first prior come from? If you picked the wrong one, then everything based on it could be wrong as well.
Although he didn't use Bayesian language, this is one of the main questions that the neglected Scottish philosopher Thomas Reid grappled with. His answer is simple: your priors should be based on common sense.
Without studying Reid's works, it is easy to dismiss his claim as either (a) Foolish, because common sense is so often wrong, or (b) Platitudinous, because everyone claims that their views are common sense. But in the end, he prevails. It is true that common sense has been wrong before: Contrary to appearances, the earth moves around the sun. But how do we unseat a common sense claim? Only by using even stronger common sense claims - like "perception is valid" - against weaker ones. And it is not true that everyone claims that their views are common sense - many philosophers delight in doing the opposite.
The quickest way to understand Reid is with a simple example. Suppose someone shows that (A implies B). B is totally contrary to common sense. Should you accept B? Hardly. If (A implies B), then (Not-B implies not-A). That's basic logic. Therefore you have not one but two valid arguments. Which one should you accept? The one with the more obvious premise. You have to ask yourself, "Which is more likely? That A is true, or that not-B is true?"
This may seem far away from economics, but it's not. Reid's emphasis on common sense is very helpful when you read or conduct empirical research. For example, unlike many critics of Card and Krueger's research on the minimum wage, I never angrily dismissed their work as dishonest trickery. My reaction was simply that they were probably wrong because their conclusion went against common sense. Which is more likely? That employers do not buy less labor when wages rise? Or that econometrics is not that reliable in this area? I go with the latter. Of course, per Bayes' Rule, C-K's research made me less confident than I was before. But not too much. (See here, pp.81-3, for exact calculations).
P.S. Philosopher Michael Huemer of the University of Colorado defends the philosophy of common sense better than Reid himself did. For a sampler, check out here, here, and here. Yes, sometimes the sequel is better than the original.