Contextual bandits and how learning systems actually behave
Contextual bandits are a great idea in general. It’s just that they’re usually implemented to make several specific, poor decisions. Contextual bandits are one of the workhorses of modern decisioning. They show up in marketing, recommendations, ranking, and experimentation systems because they solve a simple problem: you have several things you could do, you do […]