From Scores to Probabilities
A classifier network ends with a score for each possible answer. Softmax turns the scores into probabilities that add up to 1: bigger scores get a bigger share. The same idea lets a language model choose between thousands of possible next words.
Examplepython
Quick check
What do softmax outputs always add up to?
Your turn: write the code
Apply softmax to the scores [1, 1, 1] and print the probabilities rounded to 3 decimals.
Finish the quick check (and any code exercise) to complete this lesson, or mark it done yourself.
Tip: use the left and right arrow keys to move between lessons.