Insights are patterns in the observations we make in the world.
They give us an understanding of a specific cause and effect within a specific context. And help us explain our observations.
We find them subconsciously, and we aren’t actually aware of the chain of inferences that yield insights. Most of the work happens in the background as our brain is making sense of vast quantities of information. [1]
Having an insight moves us from a state of not knowing how to solve a problem to a state of knowing how to solve it.[3]
They feel like a lightning bolt and literally give you a hot flush, when you realise “That’s what’s going on here! I had no idea!I was thinking about it the wrong way! And that means that ...[!!!]” It’s because bits of existing knowledge align in your head just the right was, and some new observation lights the gunpowder and boom! - all is revealed.[2]
Actively looking for patterns in the data or information you gather takes a lot of time. It’s their subconscious nature that makes them unpredictable, and therefore unreliable in the business context.
When you’re doing research in a commercial setting - the organization’s or client’s objectives are what drives the efforts. You’re never there to just have nice chats with people, you’re there to crack a problem.
In a business context, you usually don’t have weeks or even days of analysing data post-research. So it is difficult to keep digging for the ultimate “why?”
But it’s important to keep our eyes and ears open for new observations, and be open to exploring the issue from multiple angles. [2]
We need insights when we are stuck. When we are trying to solve a problem, but are unable to find a solution. [4]
There are three reasons why we can get stuck with these problems[5]:
In 1507, John Damian strapped on wings covered with chicken feathers and jumped from the walls of Stirling Castle in Scotland, breaking his thigh; he later blamed it on not using eagle feathers. [10]
In the early 16th century William Dunbar wrote a poem “A Ballad of The False Friar of Tongland, How He Fell in the Mire Flying to Turkey” about it, mocking his attempts. While pillorying this event, Dunbar makes a broader attack on Damian's character, depicting him as a habitual charlatan. [11]
Perhaps he wasn’t a charlatan, and just acting on a misinterpretation of the problem elements? 🤔
Until the 19th century many people had postulated that the key to human flight is going to be in understanding how birds fly.
Differences in specific gravity, special construction of the skeleton, and the like, were believed to account for the ability of birds to sustain and alter their position in the air. It wasn’t until Otto Lilienthal, that anyone thought of investigating the structure and mechanics of their wings. [12]
He reframed the problem as such:
At the very first glance we notice that the slender, slightly curved wings execute a peculiar motion, in so far as only the wing-tips move appreciably up and down, whilst the broader arm-portions near the body take little part in this movement, a condition of things which is illustrated in Fig. 76.
Does not this peculiarity show us another means of facilitating flight, and of reducing the necessary expenditure of energy? May we not assume that the comparatively motionless parts of the wings enable the gull to sail along, whilst the tips, consisting of easily rotating feathers, serve to compensate for the loss of forward velocity ? It is unmistakable that the wide Portion of the wing close to the body, which does little work and has little movement, is intended for sustaining, whilst the narrower tips, with their much greater amplitude of movement, have to furnish the tractive power necessary to compensate for the resistance of the bird's body and for any possible restraining component.
Source: Otto Lilienthal bird flight as a basis of aviation, New York 1911
His insight led to the glider experiments which were the foundation of the work for the Wright Brothers. As they figured out how to make human flight possible.
# 3 Not knowing enough
Finally, when the Wright brothers started their experiments they wrote the following in a letter to the Smithsonian:
The Smithsonian Institution, Washington:
Dear Sirs:
“I am an enthusiast, but not a crank in the sense that I have some pet theories as to the proper construction of a flying machine. I wish to avail myself of all that is already known and then if possible add my mite to help on the future worker who will attain final success.”
-Wilbur Wright
The believed that careful study of aerodynamics and control with simple hang gliders, would lead to a more sophisticated powered airplane capable of sustained, controlled flight.
Their insight: if the wing on one side of the aircraft met the oncoming flow of air at a greater angle than the opposite wing, it would generate more lift on that side. In response, that wing would rise, causing the aircraft to bank. If the pilot could manipulate the wings in this way, he could maintain balance and turn the aircraft as well.
An insight problem requires us to shift our perspective and view the problem in a novel way in order to achieve the solution. They are different from non-insight problems, where the solution can be constructed incrementally based on our existing mental models. [4]
To overcome these, we have to break our line of reasoning allowing us to shift our solution strategy and find new paths to the solution. [6]
What does it take to find Insights?
People who are most successful at solving insight problems develop a representation of the problem and apply heuristics to transform the problem space so that it looks like the solution space. Eventually, when progress stops, they apply the “restructure when stuck” heuristic. [6]
Solving insight problems requires a deeper conceptual understanding allowing us to select relevant knowledge components and combine them in novel ways, or to guide us to attend to the environmental stimuli that are most relevant. [8]
That’s why it gets easier to find new insights as you develop expertise in a particular area. [9]
The three ways you can get better at finding insights are [1]:
The three practices above can help us develop a deep and complete understanding of what’s going on - and keep us attuned to what we’re looking to understand and why.
The subconscious flashes of inspiration seem to start coming more reliably then. Developing these mental models doesn’t rely on insights, but they can help to generate ideas to test and explore more easily - and lead to those insights.
The key takeaway is to note that finding insights depends on the mental models we frame - i.e. how we store and organize information in our brain. One of the problems is that these models are hidden from us, and it isn’t easy to keep track of everything we learn/observe.
We’ve been working to solve this problem by thinking of simple ways to categorize and organize observations in the data we gather - so we can easily access and analyse our mental models. As well as share them with everyone else so we can refine those models and get better at finding insights faster.
Last week I shared my analysis of what it takes to find insights, and I received very helpful comments from experts in the field. They highlighted areas in my previous article which I hadn’t covered.
I took their feedback and synthesized it to develop a more refined understanding of the subject. This article serves to share those insights.
Here are the steps:
I did all this in three hours this morning by dogfooding our product. We’re building it to simplify how to organize and make sense of qualitative data, find and share insights.
We’re currently doing a closed beta, and would love to have you guys try it out and get your feedback on whether we’ve able to simplify finding insights in a meaningful way.
Let us know if you’re interested by requesting access here. A little more about the product over here.
It has taken us several rounds of testing to get into a shape where it is simple to use. The solution is based on the principles from Grounded Theory, and Thematic Analysis and designed to help make sense of observations from qualitative data.
Further reading.
You can read more about how doing thematic analysis helps in making sense of qualitative data over here.
And checkout our analysis of how to find insights over here.
And subscribe to our blog for more on user research, ux, design thinking, lean startup, dual-track agile, product management, and innovation.
Credits:
A special thank you to Amos Schorr, Igor Zakhlenuik, Gaël Laurans, Arik Abel, Lisa J. for helping us develop a better understanding of insights with your comments.
About Me:
About me — I’m Arnav, the co-founder at Epiphany. You can get in touch with me here.
References:
[1] Based on comments from Amos Schorr, Principal Hack Summit Labs
[2] Based on comments from Igor Zakhlenuik, Insight Lead, Market Gravity.
[3] The Search for Insight: Grappling with Gestalt Psychology’s Unanswered Questions. (1994). The Nature of Insight. doi: 10.7551/mitpress/4879.003.0004
[4] Getting Into and Out of Mental Ruts: A theory of Fixation, Incubation, and Insight. (1994). The Nature of Insight. doi: 10.7551/mitpress/4879.003.0011
[5] Jason van Steenburgh, J., Fleck, J. I., Beeman, M., & Kounios, J. (2012). Insight. In The Oxford Handbook of Thinking and Reasoning Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199734689.013.0024
[6] Kaplan, C., & Simon, H. (1990). In search of insight. Cognitive Psychology, 22(3), 374-419. doi: 10.1016/0010-0285(90)90008-r
[7] Ohlsson, S. (1992). Information-processing explanations of insight and related phenomena. In M. T. Keane & K. J. Gilhooly (Eds.), Advances in the psychology of thinking (Vol. 1, pp. 1–44). London: Harvester-Wheatsheaf.
[8] Wertheimer, M. (1945/1959). Productive thinking (Enlarged ed.). London: Tavistock Publications.
[9] Reimann, P., & Chi, M. T. H. (1989). Human Expertise. Human and Machine Problem Solving, 161–191. doi: 10.1007/978-1-4684-8015-3_7
[11] Wikipedia: The Fenyeit Freir of Tungland
[12] Otto Lilienthal: bird flight as a basis of aviation, New York 1911[13] Inventing a Flying Machine
Subscribe to epiphany’s newsletter for insights on innovation, user research and product discovery
Learn about the role of the problem space in product management.
.jpg)
In this article, we’ll walk you through finding the best-fit users for user research.
Taking notes during user research sessions allows you to keep track of what you learned from each session, and what you need to do next. Here are the steps you can to improve your user research note-taking.
