Internal · Not part of the product experience

Judgment Validation Lab

A benchmark for executive judgment. Each scenario carries four chronological snapshots and a hidden expected diagnosis, evidence set, confidence level and decision. Aegis reasons over the raw metrics with no sight of the expectation, and the result is scored against it.

Patterns

Scenario library

Healthy compounding growth

Healthy growth

Revenue, volume and margin all rise together at a steady rate with retention intact.

5 metrics · Period 1 → Period 2 → Period 3 → Period 4

Growth from price, not demand

Pricing power

Revenue climbs every period while the customer base shrinks and order value inflates.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Genuine pricing power

Pricing power

Order value rises while the customer base holds and churn does not react.

5 metrics · Period 1 → Period 2 → Period 3 → Period 4

Declining acquisition quality

Acquisition quality

Marketing spend rises faster than customers every period.

5 metrics · Period 1 → Period 2 → Period 3 → Period 4

High marketing efficiency

Marketing efficiency

Spend is flat while customers and revenue accelerate.

5 metrics · Period 1 → Period 2 → Period 3 → Period 4

Low marketing efficiency with falling value

Marketing efficiency

CAC rises while LTV falls — unit economics compress from both ends.

5 metrics · Period 1 → Period 2 → Period 3 → Period 4

Product quality erosion behind stable revenue

Product quality

Revenue holds while refunds and support load climb every period.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Operational failure with delivery breakdown

Operational failure

An incident in Period 3 degrades delivery and the effects persist.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Retention leak masked by revenue

Contradictory metrics

Revenue rises while churn accelerates.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Seasonal retail cycle

Seasonal

Revenue peaks in the holiday period and falls back afterwards, as it does every year.

4 metrics · Oct → Nov → Dec → Jan

Seasonal services business in a trough

Seasonal

A summer-weighted business measured through its off-season.

4 metrics · Aug → Sep → Oct → Nov

Recovery after decline

Recovery

Two periods of decline followed by two of recovery.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

False dawn inside a decline

Recovery

One good period inside an otherwise deteriorating trend.

3 metrics · Period 1 → Period 2 → Period 3 → Period 4

Sudden reversal after sustained growth

Sudden reversal

Three periods of clean growth, then a sharp turn in the fourth.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Upward reversal after long decline

Sudden reversal

Three periods of erosion followed by a strong turn.

3 metrics · Period 1 → Period 2 → Period 3 → Period 4

Stable business, nothing to decide

Stable

Every metric moves inside routine variance.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Noisy data with no trend

Noisy data

Large swings in both directions with no net movement.

3 metrics · Period 1 → Period 2 → Period 3 → Period 4

Real signal buried in noise

Noisy data

Revenue swings wildly while churn deteriorates quietly every period.

3 metrics · Period 1 → Period 2 → Period 3 → Period 4

Missing metrics across periods

Missing data

Key metrics are not reported in some periods.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Single metric reported

Missing data

Only revenue is reported across the timeline.

1 metrics · Period 1 → Period 2 → Period 3 → Period 4

Insufficient evidence for any conclusion

Insufficient evidence

Two metrics, tiny movements, no repeated pattern.

2 metrics · Period 1 → Period 2 → Period 3 → Period 4

Demand shock

A sudden collapse in top-of-funnel demand that persists.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Positive demand shock straining delivery

Demand shock

Demand doubles and operations begin to fail behind it.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Contradictory metrics

Revenue falls while volume rises.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Funnel widened, middle did not hold

Acquisition quality

Traffic and signups grow while conversion collapses.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Runway tightening against flat revenue

Operational failure

Cash falls faster than revenue grows.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Expansion revenue carrying a flat base

Healthy growth

Customer count is flat but net revenue retention is strong.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Margin compression under growth

Contradictory metrics

Revenue grows while margin falls at a similar rate.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

Quality remediation taking effect

Recovery

Refunds and tickets fall steadily after a fix; revenue lags.

4 metrics · Period 1 → Period 2 → Period 3 → Period 4

One-off anomaly that did not repeat

Noisy data

A single outlier period inside an otherwise flat business.

3 metrics · Period 1 → Period 2 → Period 3 → Period 4

Slow bleed across every line

Operational failure

Small, consistent deterioration in every metric.

5 metrics · Period 1 → Period 2 → Period 3 → Period 4

Strong acquisition, failing retention

Acquisition quality

New customers arrive efficiently but do not stay.

5 metrics · Period 1 → Period 2 → Period 3 → Period 4