AI Is Mathematics: Why It Will Not Develop Consciousness

Philoso­pher Dieter Mer­sch has a clear answer to the recur­ring claim that AI is rac­ing toward super­in­tel­li­gence or con­scious­ness. In a recent inter­view, he calls cur­rent sys­tems math­e­mat­ics machines. They opti­mize func­tions, rec­og­nize pat­terns, and max­i­mize prob­a­bil­i­ties. The results can be strik­ing. The under­ly­ing process is not mysterious.

The Mathematical Limits

Mer­sch draws on three clas­sic lim­its from the phi­los­o­phy of math­e­mat­ics. Gödel’s incom­plete­ness the­o­rems show that no suf­fi­cient­ly com­plex for­mal sys­tem can fully describe itself. Tur­ing argued that invent­ing new con­cepts requires intu­ition that sits out­side pure for­mal­iza­tion. Tars­ki demon­strat­ed that for­mal sys­tems gen­er­ate only for­mal seman­tics; they do not pro­duce gen­uine judg­ments of truth, rel­e­vance, or mean­ing. What can­not be math­e­ma­tized remains inac­ces­si­ble to them.

This is why self-correction and multi-agent setups do not change the fun­da­men­tal pic­ture. Those mech­a­nisms remain recur­sive cal­cu­la­tions. They improve out­puts inside the exist­ing math­e­mat­i­cal struc­ture. They do not step out­side it. 

Humans, by con­trast, notice that the act of think­ing always exceeds the con­tent of any par­tic­u­lar thought. That gap is not a bug. It is the con­di­tion for gen­uine reflex­iv­i­ty, cre­ativ­i­ty, and free­dom. AI can sim­u­late the appear­ance of reflec­tion. It does not per­form it.

Art, Imitation, and the Reflexive Stance

The same limit applies to art. Sys­tems can imi­tate styles with high fideli­ty. They do not pro­duce the kind of prac­tice that ques­tions its own see­ing, its tra­di­tions, or the rela­tion between image and world. That requires a reflex­ive stance that the math­e­mat­ics does not supply.

The Cultural Risk

Mersch’s deep­er warn­ing is cul­tur­al rather than tech­ni­cal. The real risk is not that machines will replace human intel­li­gence. It is that we will lower our stan­dards until the two appear inter­change­able. When stu­dent texts become smoother yet less dis­tinc­tive, when jour­nal­ism and research set­tle for com­pe­tent sur­faces, and when nov­el­ty is mea­sured only by sta­tis­ti­cal sur­prise, cul­ture flat­tens. We lose the awk­ward, spe­cif­ic voic­es that still carry actu­al thinking.

Connections to the Broader Debate

This view aligns with my prac­ti­cal stance already devel­oped on this web­site. Treat­ing AI as an ora­cle invites peo­ple to out­source judg­ment in med­i­cine, finance, and every­day deci­sions. The eth­i­cal task is not to reject the tool but to keep human agency intact. The same point appears when AI is framed as a tool rather than a crea­ture or a god.

Once the exis­ten­tial pack­ag­ing drops, clear­er ques­tions become pos­si­ble: what does this sys­tem actu­al­ly do, where does it ampli­fy exist­ing strengths or weak­ness­es, and how should we design around it?

The need for a Mind­ful Rev­o­lu­tion fol­lows direct­ly. Com­plex sys­tems accu­mu­late entropy. Nations, insti­tu­tions, and tech­nolo­gies grow more intri­cate until ordi­nary cor­rec­tions no longer restore order. Humans can still reflect on their own gen­er­a­tive mod­els and update them delib­er­ate­ly. That capac­i­ty is not auto­mat­ic. It is trained through atten­tion, self-observation, and the will­ing­ness to revise habits of thought.

AI lacks the equiv­a­lent. It can­not notice that it is oper­at­ing inside a par­tic­u­lar for­mal frame and choose to leave it. The human prac­tice of observ­ing both the tech­nol­o­gy and the observ­er there­fore remains the scarce resource.

Software, Hardware, and the Boundary

Ralf Otte’s book Maschi­nen­be­wusst­seinrais­es a relat­ed but dis­tinct ques­tion. He argues that soft­ware run­ning on con­ven­tion­al von Neu­mann archi­tec­tures remains pure math­e­mat­ics and can­not gen­er­ate con­scious­ness. Only a shift toward brain-inspired, neu­ro­mor­phic hard­ware might pro­duce some­thing he calls machine con­scious­ness — an ele­men­tary form tied to phys­i­cal embod­i­ment rather than human expe­ri­ence. Even that prospect, how­ev­er, would still require a soci­etal deci­sion about how far to go. 

Mersch’s posi­tion is stricter: as long as the sys­tem stays with­in math­e­mat­i­cal for­mal­iza­tion on con­ven­tion­al com­put­er archi­tec­tures, feel­ings and con­scious­ness remain out­side its reach. Sim­u­lat­ing those phe­nom­e­na does not pro­duce them.

What Remains Distinctly Human

The prac­ti­cal con­se­quence is straight­for­ward. AI can accel­er­ate pat­tern recog­ni­tion, code gen­er­a­tion, and cer­tain forms of opti­miza­tion. It does not sup­ply the reflex­ive judg­ment, the sense of mean­ing, or the capac­i­ty to step out­side a given frame that human think­ing still provides. 

Keep­ing that dis­tinc­tion clear pro­tects both the use­ful­ness of the tools and the human capac­i­ties that make wise use pos­si­ble. The alter­na­tive is a grad­ual sub­sti­tu­tion of sur­faces for sub­stance — one that becomes vis­i­ble only after the flat­ten­ing is already widespread.

Leave a Reply

GOOD READS

The Mind­ful Rev­o­lu­tion, Michael Reuter

Die Acht­same Rev­o­lu­tion, Michael Reuter

What‘s our prob­lem?, Tim Urban

Rebel Ideas — The Power of Diverse Think­ing, Matthew Syed

Die Macht unser­er Gene, Daniel Wallerstorfer

Jel­ly­fish Age Back­wards, Nick­las Brendborg

The Expec­ta­tion Effect, David Robson

Breathe, James Nestor

The Idea of the Brain, Matthew Cobb

The Great Men­tal Mod­els I, Shane Parrish

Sim­ple Rules, Don­ald Sull, Kath­leen M. Eisenhardt

Mit Igno­ran­ten sprechen, Peter Modler

The Secret Lan­guage of Cells, Jon Lieff

Evo­lu­tion of Desire: A Life of René Girard, Cyn­thia L. Haven

Grasp: The Sci­ence Trans­form­ing How We Learn, San­jay Sara

Rewire Your Brain , John B. Arden

The Wim Hof Method, Wim Hof

The Way of the Ice­man, Koen de Jong

Soft Wired — How The New Sci­ence of Brain Plas­tic­i­ty Can Change Your Life, Michael Merzenich

The Brain That Changes Itself, Nor­man Doidge

Lifes­pan, David Sinclair

Out­live — The Sci­ence and Art of Longevi­ty, Peter Attia

Younger You — Reduce Your Bioage And Live Longer, Kara N. Fitzgerald

What Does­n’t Kill Us, Scott Carney

Suc­cess­ful Aging, Daniel Levithin

Der Ernährungskom­pass, Bas Kast

The Way We Eat Now, Bee Wilson

Dein Gehirn weiss mehr als Du denkst, Niels Birbaumer

Denken: Wie das Gehirn Bewusst­sein schafft, Stanis­las Dehaene

Mind­ful­ness, Ellen J. Langer

100 Plus: How The Com­ing Age of Longevi­ty Will Change Every­thing, Sonia Arrison

Think­ing Like A Plant, Craig Holdredge

Das Geheime Wis­sen unser­er Zellen, Son­dra Barret

The Code of the Extra­or­di­nary Mind, Vishen Lakhiani

Altered Traits, Daniel Cole­man, Richard Davidson

The Brain’s Way Of Heal­ing, Nor­man Doidge

The Last Best Cure, Donna Jack­son Nakazawa

The Inner Game of Ten­nis, W. Tim­o­thy Gallway

Run­ning Lean, Ash Maurya

Sleep — Schlafen wie die Profis, Nick Littlehales

© 2026 MICHAEL REUTER