from chart to action

Decision log

Decision log: why a page changes, which metric is expected, when to review, and what to roll back.

Without a decision log, analytics becomes a pretty storm of numbers without memory.

decision_id

Links edit, date, owner, and expected effect.

Do not make decisions without a hypothesis.

review_date

Prevents forgetting to check whether the edit helped.

A review too early produces noise.

rollback_condition

Defines upfront when to roll back a change.

Do not wait for disaster if the warning threshold is reached.

Collect the signal

Define the event, page, source, and moment where the user acted or stopped.

  • The event does not contain a private question or full scroll text.
  • There is a clear timestamp and route.
  • The signal can be tied to an owner decision.

Compare against expectation

Every number must be read beside a hypothesis: what should have happened, what happened, and how much it matters.

  • There is a baseline or first-week manual estimate.
  • No conclusion is made from one random day.
  • Devices are checked separately: mobile and desktop.

Turn into an edit

Analytics becomes useful only after action: rewrite a block, simplify a flow, add FAQ, fix an error, or close an extra door.

  • There is an owner, priority, and expected effect.
  • The change is written into the decision log.
  • A re-check date is assigned after the change.

dashboard

  • Active decisions by owner and review date.
  • Changes that improved safe next-step rate.
  • Changes that increased refunds or support tickets.
  • Rollback candidates.

alerts

  • A change launched without owner or review date.
  • A metric worsened but nobody rolled back.
  • The team argues opinions although a signal exists.

decisions

  • Roll back a change if it hurts the core flow.
  • Scale a pattern if it improved the safe next step.
  • Turn a repeated decision into a content governance rule.

red flags

  • Decision log is backfilled only to make a pretty report.
  • Nobody knows why a page was changed.
  • Everyone looks at charts, but no decisions happen.

related doors