Aug 9, 2024
Schaun Wheeler

Optimized Messaging with Learned Weights and Beta Distribution

Aug 9, 2024
Schaun Wheeler

Optimized Messaging with Learned Weights and Beta Distribution

Aug 9, 2024
Schaun Wheeler

Optimized Messaging with Learned Weights and Beta Distribution

Aug 9, 2024
Schaun Wheeler

Optimized Messaging with Learned Weights and Beta Distribution

AI agents and tagged weights

Agentic learners encode their learnings as tagged weights. At Aampe, for example, we start a new customer's agents with 35 timing tags: five three-hour increments (covering waking hours) over seven days of the week. Each agent updates the weights for each tag based on the way its assigned user responds to messages sent during each window.

Our agents also maintain tagged weights for channel, value proposition, and other copy choices, but timing actions present a unique challenge: each timing decision must consider the possibility of not taking any action at all. Friday night may be a better bet than Wednesday early afternoon, but Friday night might still be a bad bet in and of itself. The more we act on bad bets, the more we annoy users. Push notifications, emails, and other surfaces for user interaction are a gold mine of first-party data. Messaging too much dynamites the mine. No one wants that.

So, agents need a mechanism for making a go/no-go decision for every available timing slot. We use a random draw from a beta distribution to do this. The beta distribution takes an alpha and beta parameter, but there's an alternative parameterization that I find more intuitive: it takes a probability and a measure of signal strength.

The use of probability and signal strength in messaging decisions

Imagine we estimate that a user has a 75% probability of responding on Friday night. If that probability is based on having sent only one message, our probability warrants a lot less confidence than if it's based on 20 messages.

If we take the number of messages as our measure of signal strength, a 0.75 probability based on a signal strength of 1 would correspond to an alpha of 0.75 and a beta of 0.25. Draw 1000 samples from that distribution, and on average they'll approximate 0.75, but the (inter-quartile) range will run from around 0.57 to 0.99. On the other hand, if you have a signal of 20 (alpha=3.75, beta=1.25), those 1000 samples will still average 0.75, but the range will run from around 0.69 to 0.82.

So, when our agents decide whether to message at a particular time, they look up the probability (weight) and signal of that timing tag in question and use it to draw a sample from the corresponding beta distribution. If the draw is over a certain threshold (default: 0.5), the agent sends the message; otherwise, the agent skips it.

To give you some intuition around how this works, I've plotted out the distribution of weekly messaging frequency that will result from all 35 timing tags having a particular weight and signal strength. Learned weights and the beta distribution give Aampe agents a straightforward way to individually optimize timing and message frequency at the same time.

__wf_reserved_inherit
0

Related

Shaping the future of marketing with Aampe through innovation, data.

May 29, 2025

Schaun Wheeler

Discover how Aampe's semantic-associative agents adapt to varying user contexts, from fully known to unknown users, ensuring personalized experiences through continuous learning and contextual imputation.

May 29, 2025

Schaun Wheeler

Discover how Aampe's semantic-associative agents adapt to varying user contexts, from fully known to unknown users, ensuring personalized experiences through continuous learning and contextual imputation.

May 29, 2025

Schaun Wheeler

Discover how Aampe's semantic-associative agents adapt to varying user contexts, from fully known to unknown users, ensuring personalized experiences through continuous learning and contextual imputation.

May 29, 2025

Schaun Wheeler

Discover how Aampe's semantic-associative agents adapt to varying user contexts, from fully known to unknown users, ensuring personalized experiences through continuous learning and contextual imputation.

May 28, 2025

Schaun Wheeler

Explore how Aampe's semantic-associative agents differ from traditional multi-armed bandit models. Learn about their multi-dimensional action space and non-ergodic learning approach that tailors user experiences without generalization.

May 28, 2025

Schaun Wheeler

Explore how Aampe's semantic-associative agents differ from traditional multi-armed bandit models. Learn about their multi-dimensional action space and non-ergodic learning approach that tailors user experiences without generalization.

May 28, 2025

Schaun Wheeler

Explore how Aampe's semantic-associative agents differ from traditional multi-armed bandit models. Learn about their multi-dimensional action space and non-ergodic learning approach that tailors user experiences without generalization.

May 28, 2025

Schaun Wheeler

Explore how Aampe's semantic-associative agents differ from traditional multi-armed bandit models. Learn about their multi-dimensional action space and non-ergodic learning approach that tailors user experiences without generalization.

May 26, 2025

Schaun Wheeler

Traditional customer engagement tools often constrain strategies by bundling orchestration and analysis within fixed campaign structures. Adopting an agentic approach—separating orchestration from analysis—enables more dynamic, user-centered communication, allowing for nuanced decision-making and broader impact.

May 26, 2025

Schaun Wheeler

Traditional customer engagement tools often constrain strategies by bundling orchestration and analysis within fixed campaign structures. Adopting an agentic approach—separating orchestration from analysis—enables more dynamic, user-centered communication, allowing for nuanced decision-making and broader impact.

May 26, 2025

Schaun Wheeler

Traditional customer engagement tools often constrain strategies by bundling orchestration and analysis within fixed campaign structures. Adopting an agentic approach—separating orchestration from analysis—enables more dynamic, user-centered communication, allowing for nuanced decision-making and broader impact.

May 26, 2025

Schaun Wheeler

Traditional customer engagement tools often constrain strategies by bundling orchestration and analysis within fixed campaign structures. Adopting an agentic approach—separating orchestration from analysis—enables more dynamic, user-centered communication, allowing for nuanced decision-making and broader impact.

May 22, 2025

Schaun Wheeler

Agentic systems are designed to operate within a manageable state space, focusing on relevant variables to make effective decisions. This approach contrasts with traditional AI models that attempt to process vast amounts of data, often leading to inefficiencies and suboptimal performance.

May 22, 2025

Schaun Wheeler

Agentic systems are designed to operate within a manageable state space, focusing on relevant variables to make effective decisions. This approach contrasts with traditional AI models that attempt to process vast amounts of data, often leading to inefficiencies and suboptimal performance.

May 22, 2025

Schaun Wheeler

Agentic systems are designed to operate within a manageable state space, focusing on relevant variables to make effective decisions. This approach contrasts with traditional AI models that attempt to process vast amounts of data, often leading to inefficiencies and suboptimal performance.

May 22, 2025

Schaun Wheeler

Agentic systems are designed to operate within a manageable state space, focusing on relevant variables to make effective decisions. This approach contrasts with traditional AI models that attempt to process vast amounts of data, often leading to inefficiencies and suboptimal performance.

Load More

Load More

Load More

Load More