How testing in unnatural environments backfires

Thirty seconds into the interview, the respondent is still studying one poster. They know an opinion is required and sensibly manufacture one. Outside the test, the work appears beside eight competitors while the customer is thinking about dinner. Under those conditions, the element criticised as strange may be the only reason the brand is identified at all. Testing in isolation can therefore select competent invisibility: work that explains itself perfectly under forced attention and disappears when attention must be earned.

Context belongs to the task. Put the work where it will live. Show the competing messages, device, speed and sound conditions. Let people encounter it before asking for an evaluation. Measure recognition, comprehension and behaviour after realistic exposure. Then use a slower discussion to understand likely reasons rather than recreate the buying moment.

Isolation still helps diagnose whether a claim is legible or a sequence makes sense. Diagnosis and market performance answer different questions. An eye test uses one line at a time; road signs must eventually face traffic.

Run the poster for two seconds among the competing work, then ask what was recognised without replaying it. Afterwards, show it alone to investigate why. The polished option may still win. This time it has survived the encounter customers actually get.

Behavioural principles

Behavioural ideas at play in this post

Short, plain-English explanations of the principles behind this post, with links to related books and examples in the archive.