Why interpreting data at face value can backfire

Another example, this time involving Manchester United manager, Sir Alex Ferguson, didn’t have such a happy ending. Opta data showed that his star defender, Jaap Stam, was making fewer tackles each season. Ferguson promptly offloaded him in August 2001 to Lazio – keen to earn a high transfer fee before the decline became apparent to rival clubs.

However, Stam’s career blossomed in Italy and Ferguson realised his error – the lower number of tackles was a sign of Stam’s improvement, not decline. He was losing the ball less and intercepting more passes, so he needed to make fewer tackles. Ferguson says selling Stam was the biggest mistake of his managerial career. From then on he refused to be seduced by simplistic data.

These criticisms don’t mean you should disregard tracking data. Expecting any methodology to be perfect is to burden it with unreasonable expectations. Instead, you need to be aware that it merely provides evidence to which you need to apply your discretion and judgement.

Jaap Stam made fewer tackles because he had become worse. Neat story. Wrong story.

A tackle is often what happens after positioning, possession or anticipation has failed. Count only the intervention and the better defender can resemble the declining one. The data was accurate; the interpretation wandered off without it.

Business dashboards manufacture this mistake by the hour. Fewer support tickets might mean a better product, or customers giving up. More sales meetings might mean demand, or desperate calendar stuffing. A tiny bug count might signal stable software, or a reporting system everyone has learned to avoid.

Red arrows and green arrows are decoration until somebody explains the mechanism. For every metric that matters, ask what else could move it. Then pair activity with outcome and consequence: calls with resolution and repeat contact; meetings with accepted pipeline; releases with adoption and defects. Talk to the people doing the work before diagnosing them from a line chart.

“Data-driven” too often means allowing whichever number is nearest to drive. Proper judgement is slower and less impressive. It treats a metric as evidence about reality, not reality compressed into a cell.

A perfectly measured tackle can still tell the wrong story about the match.