Use a brief that resembles real work
Choose a realistic task using approved or synthetic assets. Record the objective, audience, deliverables, brand context and non-negotiables. Decide the assessment criteria before you see the result.
Control the inputs
Use the same input pack and record the plan, configuration and date. Keep a copy of prompts and settings. If one product needs extra setup, count that time.
Repeat the run
One good output can be luck. Run the task at least five times. Track completion, accuracy, consistency and what failed. Distinguish a polished demonstration from a repeatable result.
Count the full cost
Include paid usage, failed generations, setup, review and editing time. The useful measure is cost per acceptable deliverable, with the quality threshold kept consistent.
Review the controls
Inspect permissions, data policies, approval steps and failure recovery. A useful output does not justify access or actions your team cannot supervise.
Keep an evidence record
- Brief and permitted input assets
- Product, plan, test date and configuration
- Each run’s output and completion status
- Reviewer feedback and required edits
- Usage and human time costs
- Unresolved limitations and next review date
This is an evaluation guide, not a report of completed Sidekick tests. We will publish original evaluations separately when they are ready.