Glossary
Prompt pack
Reproducibility beats ad-hoc chats typed in the browser.
Stable packs make week-over-week deltas meaningful.
Definition
A prompt pack is the curated list of questions your monitoring run executes every cycle. It is the denominator for Share of Voice, the stress surface for fanout queries, and the backbone of LLM-Score. Good packs mix buyer intents, competitor comparisons, and edge cases (pricing, safety, regional nuance) without stuffing brand names into the question text.
How it's computed
Packs are versioned. When you change prompts, start a new baseline window so you do not compare incompatible histories. Getllmspy logs completion metadata so you can prove which pack version produced a dated snapshot.
How to read it
If scores swing after a pack edit, attribute the swing to methodology first. If scores swing with a stable pack, treat it as a market or model drift signal worth investigating.
When to use
- Launching monitoring for a new category.
- Aligning marketing and SEO on the same questions.
- Agency handoffs where reproducibility is contractual.