Skip to content
Subconscious

A Latent Timing Segment Is a Hypothesis, Not a Reason to Move Budget

On this page

A model that groups customer activity by day and hour can hand you a clean story: "this segment is active Tuesday mornings." That pattern is already in the data. It does not tell you what happens if you change your timing, targeting, or messaging around it.

What decision does this method force marketers to make?

A CMO or head of marketing analytics who runs this kind of pattern-discovery model faces a narrow choice: treat the segment as an actionable driver and shift spend or scheduling toward it, or treat it as a hypothesis and test the action before committing budget.

Get this wrong and a team shifts spend, send times, or messaging toward a segment whose weekly rhythm is correlational, sees no lift, and only then learns the pattern described what already happened, not what would change under a new action.

How does the underlying model work?

The technique is Latent Dirichlet Allocation (LDA), the same unsupervised topic model used in natural language processing, applied here to discretized calendar timestamps instead of words.

The mapping:

The result is a compact, interpretable summary of when different entities tend to be active, built entirely from timestamps already on hand. This calendar application draws on Will Dean's October 27, 2023 PyMC Labs webinar on Latent Calendar. The foundational method is documented in Latent Dirichlet Allocation (Blei, Ng, and Jordan, Journal of Machine Learning Research, 2003).

Where the method's own limits show up

Two properties matter for how much weight a decision can put on the output:

Stating what the method proves and what it leaves untested is what makes the output usable. The output is a discovered pattern, not a tested mechanism.

How do you turn the pattern into a tested action?

Testing a send-time hypothesis requires a controlled delivery experiment for the defined segment. Before commissioning the study, confirm who owns recipient eligibility, randomization, message delivery and outcome measurement. A modeled choice study can screen content preference; the live delivery experiment must measure the timing effect on its declared endpoint.

The practical sequence:

  1. Use the latent-component output to name a candidate segment and action. For a send-time hypothesis, define exposure in the customer’s local time and hold the message and delivery channel constant.
  2. Treat the pairing as a hypothesis, not a decision.
  3. Randomize eligible real recipients between candidate send times and a holdout schedule. Record successful delivery and a predeclared endpoint, such as clicks or purchases, before moving budget. A simulated choice between messages can test stated content preference; it cannot measure whether recipients are available to see a message at a particular hour.

A later human study should preserve the treatment and endpoint if the team wants to validate the same question. Replacing a stated preference with observed clicks changes the measured outcome and requires a separate validation.

Checklist for timing segments: event count, observation window, local timezone, seasonal stability, and performance on held-out activity.
Event counts are one input; timing segments also need comparable observation windows and stability checks.

A checklist before acting on a timing segment

Five-step timing test: discretize local timestamps, learn latent components, name an action hypothesis, randomize a delivery test, and inspect endpoint uncertainty.
A timing segment names a hypothesis to test, not a reason to move budget on its own.

Recurring weekly patterns are a starting point for a hypothesis, not a finished answer. Discuss the evidence needed for your timing decision with Subconscious.