Conditional probability is the single most important concept in...

@TivadarDanka
Tivadar Danka@TivadarDanka
13 views Feb 12, 2025 ~2 min read
Advertisement
1
Conditional probability is the single most important concept in statistics.

Why? Because without accounting for prior information, predictive models are useless.

Here is what conditional probability is, and why it is essential.
Media image
2
Conditional probability allows us to update our models by incorporating new observations.

By definition, P(B | A) describes the probability of an event B, given that A has occurred.
Media image
3
Here is an example. Suppose that among 100 people, 30 have COVID.

Based only on this information, if we inspect a random person, our best guess is a 30% chance of them having COVID.

This is not good enough.
Media image
4
We build a better model by looking at more information.

What about people exhibiting a symptom, like a fever?

It turns out that among the 100 people, 40 have a fever.
Media image
5
Let's say that a random person with a high fever walks in.

How does our probabilistic model change?

We can leverage the prior information (fever) to get a more precise diagnosis than the random 30%.
Media image
6
By taking a more detailed look, we notice that 24 people with a fever also got COVID.
Media image
7
Thus, we can compute the conditional probability by focusing only on people with a fever.
Media image
8
Using a similar logic, we get that if the patient has no fever, the probability of COVID drops to 10%!

Quite a difference between our model with no prior information.
Media image
9
Conditional probability restricts the event space, thus providing a more refined picture.

This gives better models, leading to better decisions.
Media image
10
(The numbers in this thread are all made up. There are much more precise methods for actual COVID diagnosis.)
11
Read the unrolled thread here:

tivadardanka.com/blog/condition…
12
This explanation, among other adventures into probability, will be a part of my upcoming book. Check out the early access for Mathematics of Machine Learning below!

Understanding mathematics will make you a better engineer. I want to help you with it.

tivadardanka.com/book/
13
If you have enjoyed this thread, share it with your friends and follow me!

I regularly post deep-dive explanations about mathematics and machine learning.
@TivadarDanka
Tivadar Danka@TivadarDanka
Conditional probability is the single most important concept in statistics.

Why? Because without accounting for prior information, predictive models are useless.

Here is what conditional probability is, and why it is essential.
Media image
Actions
What You Can Do
  • Export as PDF or Markdown
  • Batch Export to Notion
  • Bookmark & Highlight
  • Screenshot Tweet
Create Free Account

Includes 7-day Premium trial

Advertisement