âšł Â 17 Dec 2021
Understanding the eye-mind connection is critical to transcending distraction in design and creating focus.
If you drive up or down Interstate 95 between Virginia and Georgia, you will see sign after pun-riddled sign beckoning you to pull off the highway and enjoy the strangely diverse amenities of South of the Border. These signs are impossible to miss.
Today, over 175 South of the Border signs remain along the interstate; when I was a child making a two-day road trip from Boston to Florida, there were more than 250. Spotting them, reading them, and counting them made for an entertaining diversion for me, a bored kid in the back seat. âKeep yelling kids, theyâll stop!â; âTime for a PAWS?â; âYou never sausage a place!â; all advertising a glorified truck stop that seems to have everything from the expected â gas and food â to the unexpected â a sombrero tower, arcade, and convention center â to the unnecessary — a reptile lagoon.
Though my eight-year-old mind boggled at the feat of creating so many signs, it never occurred to me until I saw them again as an adult in the driverâs seat that they are a perfect exhibit of the eye-mind connection.
The connection between the eye and the mind is, especially for designers, obscured by common phrases we often use in describing the choices weâve made, our intent for them, and our analysis of how they work: This arrangement of text and image âdraws the eyeâ; this alignment maintains âline of sightâ; this heat-map âtracks the eyeâ and shows where âusers look.â But none of these expressions accurately describes what is really happening, because none of them use the word âmind.â Looking is a physically enabled act, but it is a qualitatively mental one. In fact, many specialists argue that âvision is 90% mental and 10% physical.â
As surprising as that may seem, it does reflect a true understanding of human physiology. Eyes, after all, donât do any thinking. They are as smart as the lens of your camera. In fact, they are basically the same; when open, they take in light. Light creates electrical impulses that travel the optic nerve to the visual cortex in the occipital lobes at the back of your brain. Thatâs where the âseeing,â insofar as we mean understanding happens. In other words, the eyes see without the brain, but without the brain, we see nothing.
Our entire body works like that. The majority of physical function is autonomous, which is astounding when you stop to ponder it. You donât have to consciously tell your eyes to blink, your lungs to breath, your throat to swallow, your legs to hold you up, or your fingertips to feel. Virtually every cell of your body works â can do what it needs to do — without your brainâs involvement. But our experience of every single one of the functions those cells perform does rely upon the brain. Being conscious â being aware â of what your body is doing, then, is relatively rare. When we drive, for example, we focus more on getting somewhere than on the specific interaction of our body and machine; slowing down is a conscious action, while the movement of foot from accelerator to brake becomes more and more unconscious the longer you drive. We put the operation in the background so that we are able to see and perceive the things around us â even hundreds of signs. Often our mind-body detachment is even more profound. Itâs not uncommon for commuters to be so lost in thought that they hardly experience the drive itself. The same applies to most of our mundane movements through the world. Even now, as I type this, I focus more on expressing thoughts and hardly at all on the individual movements of my fingers on keys. The gap between function and perception is wide.
As it turns out, much of design is about capitalizing on that gap. In the design of objects, understanding the careful balance of mind-body coordination is what makes for useful ones. A good object is not one that you want to be rid of, nor one that functions best when you are distracted. And yet, in the world of visual media, distraction has been a powerful tool. Take any five-minutes you experience on the web, for example, and consider how often your âeyeâ is drawn away from one thing and to another. This is by design. The entire system of digital advertising is build upon the premise that where the eyes go, the fingers will follow. And from a theoretical perspective, that adage is built upon the incredibly fragile coordination of eye and mind. It is far easier to break it than to maintain it.
Eye/Mind coordination is when your eyes, your attention, and your mind are all focused on the same thing at the same time. And, as any athlete, craftsperson, or meditation practitioner knows, it is hard to maintain! Thereâs a reason meditation is often done with eyes closed.
The eyes are no more important a sense-making tool of the body than the ears, nose, tongue, or skin. Our apprehension of reality is so much more than just seen. And yet, the seen has a much greater share of human culture than the heard, smelled, tasted or felt. That may seem hyperbolic to say, but it has actually been studied! There is quantitatively more research done on vision than any other sense, and while it has been suggested that this is so because current technology lends itself better to vision study than, say, taste study, a better reason is because civilization is built to prioritize the seen. Ask anyone who cannot see and they will tell you this is so.
Consider for just a moment how easy it is to walk down the street with earbuds in your ears, or while drinking a cup of take-out coffee, or while fully clothed and even with gloves on your hands. But now imagine the same experience â the same pre-occupation of your many senses â but with your eyes shut. How many steps do you think youâd get before falling or colliding with something or someone? The world is built by the hands, but for the eyes. And yet, the eye will wander.
A reasonable question to ask is whether, when our eyes wander, it is the eye leading the mind or the other way around, and whether weâre seeing and understanding or just seeing.
Research on this has been done, as well. In a study titled, âWhere the Eyes Wander: The Relationship Between Mind Wandering and Fixation Allocation to Visually Salient and Semantically Informative Static Scene Content,â a group of scientists attempted to observe how the mind orders and prioritizes visible information and how conscious we are of that. In the study, participants were asked to observe images of urban scenes and were prompted randomly and asked whether they were focused and attentive or whether their minds were âwandering.â Scientists noticed that participants generally retained more detailed observations when also reporting their own mind wandering than when reporting focus. In other words, it appears that âthe visual system is still able to discriminate visually salient and semantically informative scene content during mind wandering and may fixate on such information more frequently than during attentive viewing.â
Another similar study, titled âGaze-based Signatures of Mind Wandering During Real-World Scene Processing,â resulted in a similar conclusion: âgaze indices typically considered to represent greater engagement with scene processing (e.g., longer fixations) can also indicate mind-wandering.â
Set aside all the academic jargon â these studies are very difficult to read! â and the point is rather stark: our vision and perception are far sharper than is our own awareness of them. We see and understand even when we think we are not. This has major implications for design.
Still, it sounds impossible, doesnât it? But it is at the root of virtually every user-study I have run or observed. And, it underlies the age-old, intuitive design principles of arranging information to be scanned first and read second.
Recently, I ran a quick and informal study of a clientâs website in order to prove a hunch I had that their visual language was communicating the wrong things and alienating visitors. My client sells technology and expertise to wineries, and wanted to establish a connection between the value of heritage and craft held by the wine makers and the stability and stewardship their design and technology can provide. They made heavy use of old-style typefaces and historical imagery in order to make their prospects feel âat home.â But my worry was that in so heavily applying this aesthetic, the entire purpose of their business would be missed or misunderstood. As it turns out, the data showed this to be so. Despite paid media efforts driving lots of new visitors to the site, few were sticking around and even fewer were taking action. I ran a quick impression test to see what was going on â to see why they werenât seeing what they should be seeing.
The test was a classic transient attention test. I gave the participants just 8 seconds to view the homepage. They were instructed to scroll through it but not click on anything. After 8 seconds, the page was closed and they were asked to recall any visual details that stood out to them and to summarize the purpose of the page. Despite the presence of text clearly expressing the businessâs purpose of providing âcommerce technologyâ for âwine brands,â every participant recalled the imagery, which depicted an ancient Greco-Roman tapestry, and volunteered words like, âhistory,â and âarchaeology,â when asked to summarize the purpose of the page. Not a single person ever mentioned wine or technology. My point, of course, was made: the visual language was wrong. But the insight is right in line with these studies: when our minds wander, they donât stop thinking, and those thoughts form into judgements regardless of how conscious we are of that happening. For designers, understanding this is critical. We work against that reality with every image we create.
Just eight seconds is not as few as may seem. In 2015, Microsoft conducted a study and concluded that the average attention span had dropped from 12 seconds in 2000 to 8. In parallel with that drop, ten-second tests used to be common in the web design world to elicit conclusions about scalability and clarity, and as time has progressed, the testâs interval has shrunk.
It is arguable that even just 8 seconds is far longer than necessary to scan a page, perceive its contents, and make a conclusion about their nature and relevance. These days, I assume all of that can happen in just a second or two.
The goal of any page, of course, is to retain attention through its two major phases. First, transient attention, which is to say, âthe short-term response to a stimulus that distracts attentionâ and then, second, selective sustained attention, which is conscious focus. A fascinating presumption in differentiating between these two forms of attention is that transient attention â our initial attention on anything â is inherently a form of distraction.
In other words, when we first give anything our attention, it is a distraction from what we were focused on before. This is true even when we are looking for that thing. And that is where judgement comes in. We scan that thing and our mind asks, âis this the thing Iâm looking for?â and often answers âyesâ or ânoâ before we are even conscious of it. When Indiana Jones, for example, rapidly scans a room full of cups to find the true Grail, his eyes hardly rest on a single one for more than a tiny fraction of a second. And yet, his brain is calculating, cup, cup, cup, grail? no, no, no faster than he even perceives. Itâs all transient attention until his eyes rest upon that humble âcup of a carpenter,â and his attention becomes sustained.
The Grail scene is a useful illustration of how we navigate the world. And itâs a useful guide for anyone making anything that they hope will receive sustained attention. Just because your thing is the âtrue grailâ of its kind doesnât mean that your audience will âchoose wisely.â Most wonât, and wonât even be capable of doing so.
The Nielsen Norman Group has written widely on cognitive perception and usability, and one particular phenomena they have focused on is the Aesthetic-Usability Effect. Put simply, it is the positive affect that visual appeal has on sustained attention and successful use â that âusers are more tolerant of minor usability issues when they find an interface visually appealing.â Tolerance, here, isnât just about attitude. Itâs also about use. To be observably and measurably tolerant is really to respond to and/or use something more readily and successfully when it is visually appealing.
Simplicity, order, and symmetry are all elements that are typically seen as more aesthetically pleasing than their opposites â complexity, disorder, and asymmetry. These are by no means objective, but common nonetheless. And considering them in light of how we understand the eye-mind connection is critical. Because we donât typically have conscious control over how our eyes scan and the judgements our minds make, information has to overcome bodies rigged to maintain transient attention rather than sustaining focus. Seriously, we have a deeply hard time controlling our eyes and minds! Religious people have a whole thing about âbouncing your eyes in order to avoid sin because they believe that seeing and feeling are inherently difficult to control. As mocked as that perspective is, itâs not without some grounding in reality. We do scan the world, take in information, make judgements about it, and even take action as a result without consciously thinking about it. So the order of our information â how we structure it, format it, align visual anchor points to it, abstract it pictorially, edit and simplify it, and even style it all matter to how the eye portrays it to the mind.
So little of the process from sight to action can be controlled. But when we design information â when we form it with intent — a deeper understanding of the eye-mind connection will help us transcend simply harnessing distraction to sustaining attention.
It wouldnât be unfair to describe the last thirty years of interaction design as âharnessing distraction.â Digital advertising works precisely because the economics donât break down if your click is just as likely to lead you to something you donât care about as it is something you do. Itâs a deeply cynical and profitable system! And because it has been so effective â stoking desire, after all, is a million times more easily done than satisfying it â virtually every design practice in the digital landscape has taken cues from it. The result is a crowded landscape through which we voluntarily speed, faster and faster, and one in which almost every piece of information is ensconced in ulterior motive. Whatâs the point of seeing so much if we understand so little. Whatâs the point of monetizing actions if it is almost always done at the expense of focus?
If there is a single thing that I, as a designer, find hopeful about the current state of digital design it is the dismantling of the brute harnessing of distraction. While digital advertising isnât going anywhere, the way we attach ads to content is becoming more visually elegant, and less aggressively distracting. A couple of generations in to the digital landscape, weâre learning more about how perception, attention, and focus work and realizing that the short-term gold rush of profitable distraction may have run its course. Itâs by no means over â donât read me as glibly ignoring the daily annoyance of pages that expand and contract in ways that feel almost intentionally in trapping me in to mis-clicks â but we are becoming more aware of our own attentions and more inclined to maintaining control over them.
As readily as I advise my clients that fewer and fewer lookers will ever become readers, I also encourage them that there is much to be gained from just a look. And I am seeing greater interest on their part in thinking deeply about achieving clarity and simplicity, of packing as much information in as little signal, of being ever more intentional about even the smallest details of visual language. This is good for the maker and the looker because it is what eyes and minds have always wanted. Eyes respond so easily to distraction because minds want focus. What if we designed for what the mind wants, rather than what the eyes will take?
Â
đ»
Â
Striking NASA Animation Reveals the Dirty Truth About Ocean Plastic. Tilda Swinton as Libraries. This sign is a whole story. These portraits camouflaging their subjects in complex, patterned textiles are absolutely stunning. âStop trying to make Second Life happen.â The many levels of abstraction in Yankee Candle scents. New Ways of Seeing. The Mobile Phone Museum. These really make me want to play with LEGO! A peaceful moment in the snow. ShipMap.org. Competition in a single image. The Great Offline.