What is Bayes’ theorem?
The Bayes theorem, named for the 18th century British mathematician Thomas Bayes, is a mathematical formula for determining conditional probability. The theorem provides a way to review existing predictions or theories (update probabilities) given new or additional evidence. In finance, the Bayes theorem can be used to rate the risk of lending money to potential borrowers.
The Bayes theorem is also called the Bayes Rule or Bayes Law and is the basis of the field of Bayesian statistics.
Key findings
- The bayes theorem allows you to update the predicted probabilities of an event by incorporating new information.
- Bayes’ theorem is named after the 18th century mathematician Thomas Bayes.
- It is often used in finance to update risk assessment.
The formula for Bayes’ theorem is
P (a∣b) = p (a⋂b) p (b) = p (a) ⋅p (b∣a) p (b) where: p (a) = the probability of a occurring p (b) = the probability of b occurringp (a∣b) = the probability of a given bp (b∣a) = the probability of b given ap (a⋂b)) = the probability of both a and b occurring\ begin {aligned} & p \ left (a | b \ right) = \ frac {p \ left (a \ bigcap {b} \ right)} {p \ left (b \ right)} = \ frac {p \ left (a \ right) \ cdot {p \ left (b | a \ right)}} {p \ left (b \ right)} \\ & \ textbf {where:} \\ & p \ left (a \ right ) = \ text {the probability of it happening} \\ & p \ left (b \ right) = \ text {the probability of it happening} \\ & p \ left (a | b \ right) = \ text {the probability of a given b} \\ & p \ left (b | a \ right) = \ text {the probability of b given a} \\ & p \ left (a \ bigcap {b} \ right)) = \ text {likely occurs both b} \\ \ end {aligned} p ( a | b ) = p ( b ) p ( one ⋂b ) =p ( b ) p ( a ) ⋅ p ( b | a ) where:p(a)= the probability of happeningp(b)= the probability of happening bp(a∣b)=the probability of a given bp(b∣a)= the probability of b givenp(a ⋂ b ) ) = the probability that A and B occur
Bayes theorem explained
The applications of the theorem are very widespread and are not limited to the financial field. As an example, Bayes’ theorem can be used to determine the precision of medical test results taking into account the probability that a given person has a disease and the overall precision of the test. Bayes’ theorem is based on incorporating prior probability distributions to generate posterior probabilities. Prior probability, in Bayesian statistical inference, is the probability of an event before new data is collected. This is the best rational assessment of the probability of an outcome based on current knowledge before conducting an experiment.posterior probability is the revised probability of an event occurring after taking into account the new information. The posterior probability is calculated by updating the prior probability using Bayes’ theorem. In statistical terms, the posterior probability is the probability that a given event will occur given that event b has occurred.
Therefore, the bayes theorem gives the probability of an event based on new information that is, or may be related, to that event. The formula can also be used to see how the probability of an event occurring is affected by the new hypothetical information, assuming that the new information turns out to be true. For example, let’s say a single card is drawn from a full deck of 52 cards. the probability that the card is a king is 4 divided by 52, which equals 1/13 or approximately 7.69%. remember there are 4 kings in the deck. Now, suppose the selected card is revealed to be a face card.the probability that the selected card is a king, given that it is a face card, is 4 divided by 12, or approximately 33.3%, since there are 12 face cards in a deck.
Deriving the Bayes Theorem Formula with an Example
Bayes’ theorem simply follows from the axioms of conditional probability. Conditional probability is the probability of a given event that another event occurred. For example, a simple probability question might ask, “What is the probability that the share price of amazon.com, inc., (nyse: amzn) will fall?” conditional probability takes this question a step further by asking, “what is the probability that the stock price will fall given that the dow jones industrial average index (djia) fell earlier?”
The conditional probability of a given that b has happened can be expressed as:
If a is: “the price of amzn falls”, then p (amzn) is the probability that amzn will fall; yb is: “djia is already down”, and p (djia) is the probability that djia falls; then the conditional probability expression is read as “the probability that amzn will fall given a decrease in djia is equal to the probability that the price of amzn will decrease and djia will decrease above the probability of a decrease in the index djia.
P (amzn | djia) = p (amzn and djia) / p (djia)
P (AMZN and djia) is the probability of both a and b occurring. this is also the same as the probability that b occurs multiplied by the probability that b occurs given that a occurs, expressed as p (amzn) xp (djia | amzn). The fact that these two expressions are equal leads to Bayes’ theorem, which is written as:
Yes, p (amzn and djia) = p (amzn) xp (djia | amzn) = p (djia) xp (amzn | djia)
Then, p (amzn | djia) = [p (amzn) xp (djia | amzn)] / p (djia).
Where p (amzn) and p (djia) are the probabilities of Amazon and the dow jones going down, regardless of each other.
The formula explains the relationship between the probability of the hypothesis before seeing the evidence that p (amzn), and the probability of the hypothesis after obtaining the evidence p (amzn | djia), given an Amazon hypothesis given evidence in the dow.
Numerical example of Bayes’ theorem
As a numerical example, imagine that there is a drug test that is 98% accurate, which means that 98% of the time it shows a true positive result for someone who uses the drug and 98% of the time it shows a true negative result. for non-drug users. then suppose that 0.5% of the people use the drug. If a randomly selected person tests positive for the drug, the following calculation can be made to see if the probability that the person is actually a drug user.
(0.98 x 0.005) / [(0.98 x 0.005) + ((1 – 0.98) x (1 – 0.005))] = 0.0049 / (0.0049 + 0.0199) = 19.76%
Bayes’ theorem shows that even if a person tested positive in this scenario, the person is actually much more likely not to be a drug user.




