Blog
Decision making under uncertainty, with simulations that run in your browser.
Multi-Armed Bandits
-
The Casino
Random, epsilon-greedy and UCB strategies compete over a row of slot machines.
-
Regret
Measuring the cost of bad decisions as opportunity loss.
-
Dynamic Environments
What happens to each strategy when the world changes underneath it.
-
Contextual Bandits
Segmenting an audience and running an experiment per context.
-
The Tyranny of Averages
Why iterative A/B testing is the wrong approach to user experience optimization.
-
Variant Iteration: Finding New Best Variants
Coming later.
-
Sequential Decision Making
Coming later.
Reinforcement Learning
-
The Value of a Blackjack Strategy
Sutton and Barto's simplified blackjack: how good is each state of the decision space under a given strategy?