
ON the 300th anniversary of Johannes Keplerâs death, Albert Einstein said: âIt seems that the human mind has first to construct forms independently before we can find them in things.â He was referring to Keplerâs astounding deduction that the orbits of planets around the sun were not circular as scholars had believed, but elliptical â a feat that would set the stage for Newtonâs laws of motion.
Were Einstein alive today, he might be amazed at his own prescience. Modern neuroscience seems to agree with him, as it struggles to explain how 1400 grams of gelatinous stuff in a bony skull creates an inner world. âThe mystery is, and remains, how mere matter manages to give rise to thinking, imagining, dreaming, and the whole smorgasbord of mentality, emotion, and intelligent action,â writes Andy Clark in his new book, Surfing Uncertainty. âBut there is an emerging clue.â
The clue is prediction. As Einstein surmised, our brains do indeed seem first to construct forms in order to find them in the world outside. Our bodies are constantly being bombarded by sensations. Our brains have to make sense of that chaotic, often uncertain input, and they do so every moment by making predictions, or educated guesses, about what might be generating the signals impinging on us. How that leads to perception, action and an embodied mind comprises the âpredictive processing storyâ, synthesised in delicious detail in Clarkâs book.
Advertisement
The traditional bottom-up view of visual perception, for example, holds that our brain analyses incoming signals, finds patterns of ever-increasing complexity, and makes sense of whatâs out there by matching observed patterns against internal representations. Predictive processing turns these notions upside down.
In this paradigm, which has its roots in ideas developed by German physician Hermann von Helmholtz in 1860, our brains actually generate sensory data to match whatâs coming in, using internal models of the world and of our bodies. These âgenerative modelsâ give rise to multiple hypotheses about the sources of the incoming sensory data, and the most likely hypothesis becomes a perception.
But this is an ongoing process. The brain compares generated with incoming data, identifies any errors and updates its internal models as necessary, so that it can predict and thus perceive more accurately the next time around.
The paradigm, says Clark, is one of a multilayered brain, where predictions flow down from higher cortical layers to progressively lower layers, and error signals flow from the bottom up as well as laterally within each layer. Errors can be given more or less credence, depending on the context. Itâs all about minimising uncertainty.
This way of thinking about the brain hides something profound: in order to generate sensory data, the brain must know something about the way the world works and how bodies move in this world. But no one is feeding it textbooks. So when the brain creates accurate internal models â over evolutionary timescales or an organismâs lifetime â it is akin to understanding the physical world. Indeed, it is akin to understanding ourselves as embodied minds navigating our environments.
âTo make sense of chaotic inputs, the brain makes educated guesses as to what generates themâ
Surfing Uncertainty is full of examples that are strongly suggestive, bordering tantalisingly on proof, that this is how brains work. One that swayed me involves sine-wave speech â a degraded, coarse version of a speech recording. You can try to make sense of it yourself by finding an online example.
Listen hard: itâll be pure R2-D2. Next, listen to the original sentence, then to the degraded version. This time, you will start to hear the words, albeit patchily. Thatâs because your brain now has prior knowledge, which it uses to generate hypotheses about whatâs creating the sine-wave speech. The best hypothesis is what you perceive. Itâs a striking example of the brain making meaning where none existed.
The fact that we are active agents ties neatly into this predictive processing story. Brains have to reduce prediction errors if we are to perceive the world correctly â a must for survival. They can, of course, do this by âfinding the predictions that best accommodate the current sensory inputsâ, explains Clark.

They can also do this by making our bodies move, forcing them to seek sensations so that hypotheses can be verified or rejected, refining internal models. As Clark writes, neatly alluding to the bookâs title: âWe are not cognitive couch potatoes idly awaiting the next âinputâ, so much as proactive predictavores â natureâs own guessing machines forever trying to stay one step ahead by surfing the incoming waves of sensory stimulationâ.
This is a book for which most of us will need to brace ourselves: it is more monograph than popular science, which means the going is tough. But grappling with technical language and concepts is repaid with fresh insights and intensely evocative moments.
For example, Clark sees the predictive brain as an âaction-oriented engagement machineâ, constantly configured and reconfigured by the body and the environment, which in turn are being shaped by a voracious brain as it seeks to make sense of the outside world. As he puts it: âThis pattern repeats at more extended scales of space and time, as we structure (and repeatedly restructure) the social and material worlds that slowly but surely structure us.â
âWe are not cognitive couch potatoes idly awaiting the next âinputâ, so much as proactive predictavoresâ
Cognitive processes like attention also fit well into the story. Attention, in predictive processing, assigns high integrity to incoming data, so that any prediction errors are taken more seriously and internal models updated as needed. On the other hand, if you are doing something mostly without paying conscious attention, prediction errors donât carry the same import, and internal models hold sway.
Crucially, the fact that a brain filled with such internal models can generate sensory data on its own, independent of actual sensations, allows us to imagine, to dream and to time-travel mentally. We owe our inner lives to âprobabilistic generative modelsâ, as obtuse as that sounds. This inner life includes perception of our own body: according to the predictive-processing idea, even our sense of being embodied emerges from generative models that try to infer the causes of both external and internal sensations (such as signals from the gut).
But predictive processing, it turns out, comes with a dark side. Predictions can go awry, leading to delusions and hallucinations, for example, in people with schizophrenia. This also shows how perception and cognition may not be as distinct as we once believed: what we know and how we think can influence perception, which in turn modulates thought and knowledge.
Of course, predictive processing canât explain how consciousness emerges from the material brain. But Clark is optimistic. âMight we, inch-by-inch and phenomenon-by-phenomenon, begin to solve the so-called âhard problemâ of conscious experience?â he asks. âIt is far too early to say, but it feels like progress,â he answers.
In Surfing Uncertainty, Clark makes a formidable case for predictive processing, one that synthesises the work of many well-known researchers, such as Geoffrey Hinton and Karl Friston. But he is suitably cautious in not overstating the case, peppering his book with caveats for balance: âIf the predictive processing story is on trackâ is one favourite.
There are dangers in being seduced by the allure of predictive processing. But proof, one way or the other, may come from our efforts to create intelligent and conscious agents, and from seeing how they do what we do.
It may be a tall order, but as Nobel laureate Gerald Edelman and Giulio Tononi pointed out in their book A Universe of Consciousness: âAfter all, it has been done at least once by evolution.â They meant our brain, of course.
Surfing Uncertainty: Prediction, action, and the embodied mind
Oxford University Press
This article appeared in print under the headline âPredicting the worldâ