Glossary
Dated snapshot
Proof for leadership that a metric moved, not vibes.
Pairs with prompt pack versioning and LLM-Score trends.
Definition
A dated snapshot is the immutable record of what models answered for a given prompt at a recorded time—raw text, model name, completion metadata, and your scoring overlay. It is the audit trail behind charts. When stakeholders argue about a number, snapshots settle the debate.
Comparison example
| Item | Snapshot A (Apr 12) | Snapshot B (May 10) | Change |
|---|---|---|---|
| Prompt pack | b2b-core-v3 | b2b-core-v3 | same |
| Models run | 8 | 8 | same |
| LLM-Score | 41 | 49 | +8 |
| Owned citation share | 17% | 26% | +9 pp |
Mini timeline:
Apr 12 score 41 ▇▇▇▇▇
Apr 26 score 45 ▇▇▇▇▇▇▇
May 10 score 49 ▇▇▇▇▇▇▇▇▇
Because methodology stayed unchanged, the movement is likely real.
How it's computed
Every Getllmspy run stores completions in the report artifact. PDF exports preserve the same timestamp. When models refresh behavior intraday, your snapshot still reflects the world at the moment you paid for the run—important for regulated teams.
Snapshot consistency formula
For two periods to be compared as a true trend, keep:
Prompt pack version: same
Model coverage set: same
Scoring profile: same
How it works in practice
What teams store per run
- Prompt text and prompt ID
- Model identifier and region
- Full raw answer text
- Citation list and extracted domains
- Scored fields (mention, correctness, sentiment)
This is why you can defend any KPI in front of leadership: every chart point has evidence under it.
How to read it
Compare snapshots only when the prompt pack and model coverage match; otherwise label the diff as methodological. Look for citation changes, sentiment shifts, and new competitors entering lists.
Snapshot governance checklist
- Freeze one production prompt pack for at least 4 weeks.
- Name every run with date + pack version.
- Store PDF and raw JSON in one internal archive.
- Mark any methodology change in release notes.
- Share one evidence quote per major KPI delta.
- Keep rollback copies so analysts can re-open prior quarter evidence instantly.
Audit maturity benchmark
| Level | Snapshot practice |
|---|---|
| Basic | Monthly screenshots only |
| Solid | Weekly snapshots + fixed prompt pack |
| Advanced | Weekly snapshots + change log + evidence archive |
If you cannot reproduce last month's number from a stored snapshot, monitoring is not yet leadership-grade.
For executive decks, attach one dated quote per major delta so the narrative is always evidence-backed.
When to use
- Weekly monitoring emails.
- Legal or PR documentation.
- Postmortems after a GEO experiment ships.