Instrument the JourneyArrows or space to advance · F for fullscreen · ⌘P to save as PDFSessions

Growth Loops · Session 01 · Dates TBD

Instrument the Journey

A product scorecard built from behavior you can trust

Ship AIPhoenix, ArizonaPress → to begin

Ship AIInstrument the Journey01/20

A dashboard cannot rescue a vague question.

Tonight starts with the decision, follows one user through the product, and earns the right to put a number on the screen.

Ship AIInstrument the Journey02/20

Tonight

  1. 01Name the weekly decision the scorecard must support
  2. 02Define the customer action that represents value
  3. 03Separate the outcome, its drivers, and its guardrails
  4. 04Design events, properties, users, and accounts
  5. 05Instrument one core journey
  6. 06Find missing, duplicate, and misidentified events
  7. 07Build the one-page scorecard and its weekly review loop
Ship AIInstrument the Journey03/20

Where we are

  1. Session 01Instrument the Journey
  2. Session 02First Value
  3. Session 03Repeat Value
  4. Session 04Read the Curve
  5. Session 05Before They Leave
  6. Session 06Close the Loop

Six sessions, one live product. Measurement comes first because every activation, retention, and loop decision after tonight depends on these definitions and events.

Ship AIInstrument the Journey04/20

Act one

Start with the decision

A metric earns a place when a plausible change in it would alter what the team does next week.

Ship AIInstrument the Journey05/20

Build the metric from the decision backward

  1. DecisionWhat will the team choose, change, or stop each week?
  2. OutcomeWhich customer result should that decision improve?
  3. BehaviorWhat action in the product is credible evidence of that result?
  4. EventWhat observable record captures that action consistently?
  5. ViewWhat comparison makes the number actionable?

Starting from available events reverses this logic and produces dashboards full of activity with no decision attached.

Ship AIInstrument the Journey06/20

A value event is a written contract

QuestionExample answer
WhoWhich eligible customer?Workspace member with edit access
Did whatWhich completed action?report_shared
ConditionsWhat must be true?Report contains at least one saved result
CountingHow often does it count?Once per report per workspace
WindowOver which interval?Weekly, in workspace time zone

The example is illustrative. Replace the noun and conditions with the moment your customer actually receives value.

Ship AIInstrument the Journey07/20

Outcome, drivers, and guardrails do different jobs

QuestionIllustrative metric
OutcomeDid customers receive repeat value?Weekly workspaces sharing a useful report
DriverWhich behavior could explain movement?Reports created per eligible workspace
DriverWhere does the path stall?Share completion after report creation
GuardrailDid quality or trust get worse?Errors, permission reversals, unwanted sends

A driver helps diagnose. A guardrail keeps the team from raising the outcome by damaging the experience.

Ship AIInstrument the Journey08/20

Act two

Instrument the journey

Events record what happened. Properties preserve the context needed to explain why the same action behaved differently for different customers.

Ship AIInstrument the Journey09/20

A small taxonomy survives contact with the team

EventMinimum useful context
workspace_createdThe workspace existsplan · source · creator_role
data_connectedA usable source connectedsource_type · connection_result
report_createdA report was savedtemplate · result_count
report_sharedA recipient can access itsurface · recipient_count · permission
report_viewedA recipient opened itviewer_role · report_id

Prefer a few durable product verbs over an event for every click. Clicks can be diagnostics; they are rarely the value itself.

Ship AIInstrument the Journey10/20

Identity must survive the customer journey

  1. AnonymousA visitor has a device or session identifier.
  2. UserSignup attaches a stable user ID without double-counting history.
  3. AccountThe user belongs to a workspace or customer account.
  4. RoleCreator, admin, and viewer behaviors stay distinguishable.
  5. ChangePlan, role, and account moves keep an auditable effective time.

User metrics and account metrics answer different questions. Decide which entity can actually receive the product's value.

Ship AIInstrument the Journey11/20

Live build: validate one real journey

~/your-product

complete journey → inspect payload → find user

report_created fired onceworkspace_id + user_id presentreport_shared missing recipient_countproperty added; clean replay verified

Perform the core path with the analytics debugger open. Inspect the raw payload, locate the same user and account in analytics, and replay only after the defect is fixed.

A dashboard row is downstream evidence. Validation begins at the product action and follows the exact record into the analytics tool.

Ship AIInstrument the Journey12/20

The three event failures to hunt

What goes wrong

  • Missing: the action happened, no event arrived
  • Duplicate: one action produced several events
  • Misidentified: the event belongs to the wrong user or account
  • Malformed: the event arrived without usable context

How to catch it

  • Replay a known journey step by step
  • Attach a unique test record ID
  • Compare raw payload to the product state
  • Write expected count and properties first

If one action should count once, give the event a stable ID or server-side boundary that makes retries distinguishable from new actions.

Ship AIInstrument the Journey13/20

Act three

Build the scorecard

The first scorecard is intentionally small: definition, current value, comparison, owner, and a link back to the behavior behind the number.

Ship AIInstrument the Journey14/20

One page the team can operate

DefinitionDecision
Repeat valueEligible workspaces with a useful share this weekIs repeat value improving?
Activation driverNew workspaces reaching first useful shareWhere should onboarding change?
Engagement driverActivated workspaces repeating the actionWhich next action needs help?
Trust guardrailErrors and permission reversals per shareDid the change create harm?

Every row also needs an owner, update cadence, source query, and last-validated date. Two people should calculate the same result.

Ship AIInstrument the Journey15/20

A number is not ready until its limits are visible

  • CoverageWhich products, platforms, plans, or time periods are missing from the event stream?
  • LatencyHow long after the action can the event or warehouse record arrive?
  • EligibilityWho could reasonably perform the behavior and belongs in the denominator?
  • VersioningWhen the definition changes, preserve the effective date instead of silently rewriting history.

Confidence comes from knowing the boundary of the measurement, not from adding decimal places.

Ship AIInstrument the Journey16/20

The weekly measurement loop

every week
  1. 01Read the outcome and guardrails
  2. 02Inspect the driver that moved
  3. 03Choose one product decision
  4. 04Validate the events after the change

A scorecard compounds only when it changes a decision and the instrumentation is rechecked after the product changes.

Ship AIInstrument the Journey17/20

The artifact

~/your-product

save taxonomy → validation log → scorecard

value-event contract versioned5/5 journey events verifiedowners + weekly cadence assignedwrote 01-measurement/scorecard.md

Commit the metric tree, event taxonomy, identity rules, validation evidence, data caveats, and the scorecard query links as one measurement contract.

Session two uses this exact event stream to test candidate activation signals and build the signup-to-value funnel.

Ship AIInstrument the Journey18/20

Measure the decision, not the dashboard.

Ship AIInstrument the Journey19/20

Next

First Value — Session 02, Workuity Biltmore

Next session compares what retained customers did early, defines activation as a behavioral prediction, and removes one barrier on the path to first value.

shipai.club · Free, always

Session page
Ship AIInstrument the Journey20/20
01/20