1
Problem before solution
A discovery process should turn a proposed solution back into the underlying problem before committing to build.
reviewed
AI idea validation to eval
A source-backed path for turning generated AI product ideas into problem framing, validation briefs, task-specific evals, and score-gated decisions.
路径卡片
2
Validation brief
A validation brief compresses an idea into target user, problem, proof needed, and the smallest useful test.
3
Task-specific eval objective
A useful AI eval starts with a task-specific objective that names what the system must do well in its real product context.
4
Eval-driven AI development
An AI product should define how success will be evaluated before the team invests in deeper prompt, model, or workflow work.
5
Production log to eval case
Useful production logs can be converted into eval cases so real failures become repeatable tests.
6
Human-calibrated eval scoring
Automated eval scores need human calibration so the measured result still matches the product question.
7
Scoring gate
A scoring gate gives a generated idea a lightweight decision point before it receives more time.