DEEP BACKGROUND 03 OF 13 . THE MAP When can you trust what your team already knows about your audience? Under two conditions, and confidence is not one of them. The environment has to be regular enough to contain learnable cues, and the person has to have had long practice with fast, clear feedback. Everything else is a hypothesis. WHY THIS IS WORTH MONEY People who have worked in a category for a decade know things they have never been asked for. Drawing the audience before anybody shows them a chart gets it out, and it is free. It is also the step analytically minded people distrust most, and they are half right. So the useful question is not whether to use the room's intuition. It is when the room's intuition is worth anything, and there is a published answer. WHAT THE RECORD SHOWS The paper written by two people who had been arguing for years Kahneman and Klein (American Psychologist, 2009) had taken opposite public positions on expert intuition for a long time. They sat down to establish where they actually agreed, which is why this paper is worth more than either of their popular books on the subject. The agreement, in their words: "Two conditions must be satisfied for skilled intuition to develop: an environment of sufficiently high validity and adequate opportunity to practice the skill." Stated again in their conclusions: "An environment of high validity is a necessary condition for the development of skilled intuitions. Other necessary conditions include adequate opportunities for learning the environment (prolonged practice and feedback that is both rapid and unequivocal)." And the warning that matters more than the conditions "High subjective confidence is not a good indication of validity." Their explanation of why: "subjective confidence is often determined by the internal coherence of the information on which a judgment is based, rather than by the quality of that information." And: "evidence that is both redundant and flimsy tends to produce judgments that are held with too much confidence." There is no internal marker that separates a correct intuition from one produced by a bad heuristic. So you cannot judge an intuition by how sure the person sounds. You judge the conditions they learned in. They also name the domains, and the list is uncomfortable Where valid intuitive expertise is found: "livestock judges, astronomers, test pilots, soil judges, chess masters, physicists, mathematicians, accountants, grain inspectors, photo interpreters, and insurance analysts." Where it is not: "stockbrokers, clinical psychologists, psychiatrists, college admissions officers, court judges, personnel selectors, and intelligence analysts." The difference is not intelligence or seniority. It is whether the world gives you fast, unambiguous feedback on whether you were right. THE STRONGEST OBJECTION, AND THE ANSWER TO IT The strongest objection is that a formula beats the expert almost everywhere anyone has checked. Grove, Zald, Lebow, Snitz and Nelson (Psychological Assessment, 2000) meta-analysed studies comparing human judgement against mechanical prediction. "On average, mechanical-prediction techniques were about 10% more accurate than clinical predictions." Mechanical substantially outperformed human judgement in 33 to 47 per cent of studies. Human judgement was substantially better in only 6 to 16 per cent. And the clause that bites hardest: the superiority held "regardless of the judgment task, type of judges, judges' amounts of experience, or the types of data being combined." Dawes, Faust and Meehl put it in Science in 1989: across "nearly 100 comparative studies in the social sciences... In virtually every one of these studies, the actuarial method has equaled or surpassed the clinical method." Tetlock's work on political forecasting points the same way. Two hundred and eighty four professional forecasters, and in his own words, when pitted against "dilettantes, dart-throwing chimps, and assorted extrapolation algorithms" there were "few signs that expertise translates into greater ability to make either 'well-calibrated' or 'discriminating' forecasts." The answer is that all of this argues for exactly what a Fan Map does, and against the thing people usually do with a room's intuition. It argues against treating the draft as the finding. It argues for the draft being written down, dated, and then tested against something outside the room. Which is what a Fan Map is: a hypothesis with the disconfirming evidence named in advance. If the only possible outcome of your fieldwork is that the map was right, you have not built a hypothesis. You have built a slide. WHERE THE EVIDENCE STOPS Kahneman and Klein establish when intuition can be valid. They do not establish that intuition beats a model in those domains, and we do not claim it. The Grove meta-analysis is about human health and behaviour, and about prediction tasks with a scorable outcome. Naming the groups inside an audience is not that kind of task, so the transfer is arguable in both directions. Tetlock's forecast counts differ between sources and are not printed here for that reason. The two hundred and eighty four forecasters figure is verified, the rest is not. Nothing here tests a Fan Map. It tests the general standing of expert intuition, which is the ground the first draft of a map stands on. WHERE THE CONE SITS The four behaviours give you positions. The Fan Map fills them in: real groups sitting under each behaviour, named in language a person would use rather than in codes. A named group survives a meeting. A segment labelled C2 does not. Apply the two conditions without flattering anybody and you get the working rule. A twenty year veteran drafting groups in a domain they have watched closely, with real feedback on what worked, is operating in a high validity environment and their draft is worth capturing. A team new to the category is guessing, however confident the room sounds. Either way it is a hypothesis, and the meet and greets are where it gets tested rather than confirmed. WHAT TO DO ON MONDAY Get four people who know your category in a room. Give them the four behaviours and no data, and ask them to name the groups. Then, before anybody leaves, write down what would prove the map wrong. That sentence is worth more than the map. Next is the room, and why the one question everybody asks in fieldwork is the one that cannot be answered. SOURCES Kahneman, D., & Klein, G. (2009). Conditions for intuitive expertise: A failure to disagree. American Psychologist, 64(6), 515-526. doi:10.1037/a0016755 Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12(1), 19-30. doi:10.1037/1040-3590.12.1.19 Dawes, R. M., Faust, D., & Meehl, P. E. (1989). Clinical versus actuarial judgment. Science, 243(4899), 1668-1674. doi:10.1126/science.2648573 Tetlock, P. E. (2005). Expert Political Judgment: How Good Is It? How Can We Know? Princeton University Press. doi:10.1515/9781400830312 Superfandom . Deep Background . https://superfandom.ai/science/the-map/ Matt Hart . published 2026-09-08 . last changed 2026-09-09