
Measurement
Part of Measuring branding agency work across five evidence layers
Branding agencies measurement mistakes: six checks
Branding agencies measurement mistakes: six buyer checks for brand-tracking reports, covering uncertainty, outputs versus outcomes, assigned credit, series breaks, denominators and the evidence trail.
Six checks catch the common measurement mistakes in a branding agency report. Check 1: keep uncertainty attached. Check 2: separate outputs from outcomes. Check 3: describe assigned credit without claiming cause. Check 4: mark series breaks. Check 5: show the denominator beside every rate. Check 6: make the evidence trail usable.
Brand measure : The specific response being assessed, such as aided awareness, unaided awareness, consideration or brand equity.
Denominator : The people or events eligible to be counted when calculating a rate, paired with the numerator.
Output : Work completed or delivered, such as an asset, an approval or a training session.
Assigned credit : Outcomes allocated to a channel or campaign under a stated attribution rule.
Contribution : An evidence-based account of how an activity may have helped bring about change, considered alongside alternatives.
Series break : A change in question, source, population, classification or calculation that may make results across periods incomparable.
Uncertainty : Limits on interpretation that can arise from sampling, missing events, model assumptions or other study problems.
Check 1: Keep uncertainty attached to the brand measure
Treat uncertainty as part of the result, not a footnote added after a decision. A brand measure can be affected by sampling, refusal, inaccurate answers, processing errors, missing events or model assumptions.
State which limitations apply to this study, rather than relying on a general quality label to carry the interpretation.
The eligible population and survey wording help show what a response can represent. A result from exposed respondents, for example, does not automatically describe all target buyers. Use an audience research plan to examine how the group was defined and how survey design may shape what the evidence can support.
Check 2: Separate outputs from outcomes
An output confirms that work was completed; it does not by itself show a change in awareness, consideration or business performance.
Keep delivery evidence apart from outcome evidence, and identify the question each result answers. This distinction helps prevent activity records from being read as proof of audience response or commercial effect.
HM Treasury's Magenta Book, the government evaluation guidance, distinguishes implementation, impact and value for money. That framing can help clarify a private engagement without making a public-sector example an agency target. The measurement and reporting guide puts results into a broader evidence context, while the table gives a compact check for common report items.
| Report item | Evidence check |
|---|---|
| Brand measure | Keep the question wording and target population beside the result. |
| Output or outcome | Distinguish completed work from a change in awareness, consideration or business performance. |
| Assigned credit | Record the exposure window and identity rule; label the result as allocated credit. |
| Series history | Version definitions, mark breaks and state whether earlier results were restated. |
| Uncertainty | Explain how sampling and non-sampling limits affect interpretation. |
Check 3: Describe assigned credit without claiming cause
First-contact, last-contact and weighted attribution rules distribute recorded outcomes according to a chosen method. They do not create a counterfactual. A report can describe how credit was allocated, but the allocation alone cannot establish that branding caused the outcome.
When presenting assigned credit, record the exposure window, identity rule, deduplication method, unattributed cases and common outcome unit. A contribution assessment, as distinct from the attribution methods above, should set out the proposed pathway and consider alternatives, including price, product, distribution, service changes and wider conditions that may coincide with the work.
Check 4: Give each series break a boundary
A series break matters when a changed question, source, population, classification or calculation weakens comparison between periods. A move from unaided to aided awareness changes the measure, even if a chart keeps its previous label. Mark the point of change instead of presenting both values as an uninterrupted trend.
Version the definition, say whether earlier values were restated and leave the comparison limits visible. The UK Statistics Authority publishes quality standards and value standards for official statistics, not private agency reports. They provide public reference points for coherence, comparability and transparent reporting without setting agency targets.
Check 5: Show the denominator beside every rate
A percentage without its eligible base can mislead. For example, "aided awareness rose to 40 per cent" means little until the report says whether that is 40 of 100 respondents or 4 of 10, and whether the respondents were target buyers. These numbers are illustrative.
Ask for the numerator, the denominator, the question wording and the survey period beside each rate. If a rate is based on a small number of respondents, treat it as indicative and say so. If the denominator changed between waves, apply Check 4 and mark a series break.
Check 6: Make the evidence trail usable
Before release, make each material result traceable to its definition, source and calculation. Record the evidence owner, source snapshot, calculation version, decision informed and next review date. A quality assurance note should identify who checked the work and which limitations matter to the conclusion.
For external comparisons, state the basis before interpreting a relative result. A benchmark specification can make the measure, population and period explicit, while leaving unmatched evidence identified rather than concealed. A review methodology can help readers examine how a conclusion was reached.
Ask for exact metric and survey wording, the source calculation and the person responsible for review. If a correction changes the conclusion, notify the original decision owner and retain the superseded result for authorised audit. Use a selection checklist to ask for reproducible calculations; an unavailable measure should remain unavailable, not become zero.


