A Response to my Post on Semantic Engines

Here is long-time reader TB’s e-mail response to what I said yesterday.  (TB works in AI and/or adjacent fields; I didn’t press him on his employment details.) I told TB that I need a better understanding of what goes on ‘under the hood’ of these amazing engines to be sure that I am not ‘blowing smoke’ when I assert that they are not truly intelligent but merely simulate human intelligence. I have bolded a couple of key sentences and made some minor edits. It is wonderfully clear and — as far as I can judge — accurate.

……………………………..

You are 100% correct in your post in my view. I read Nagel’s most recent defence of the reality of first person consciousness a few years ago. He could have made his argument in about half the words, but he is right. Dennett and friends claim that consciousness is an illusion; there is a theory that the mind plays this trick whereby all stimulus from without gets converted to a sort of realtime stream of imagery / impressions that we mistake for consciousness. This ‘illusion’ argument seems to forget what ‘illusion’ means – first person experience. Each person’s illusion is his own. And then we realise that calling it an ‘illusion’ is meant to make us dismiss it as not real. So I think your closing comments are exactly right – the deniers want to argue that the first person experience we really are having is a) really there (something has to be there, since something is fooling us into thinking there is something there), but it’s an illusion, so ‘not real’, while simultaneously telling us b) that it (i.e. conscious experience) is not really there at all.

A few things on AI. You have undoubtedly understood that there is something called a Large Language Model (LLM). LLMs are trained on the whole internet, and in addition vast numbers of (generally illegally obtained) PDFs of physical books that the AI companies obtain, destroy the spine, and scan. All of this is the ‘training base’. Each sentence of every document, web page etc, is ‘tokenised’ and each each token is ’embedded’ in a high dimension vector space, such that concepts that frequently co-occur or appear to be used as near synonyms in similar documents, end up as vectors that are close, i.e. whose normalised mathematical projection (cosine) is close to 1.0.

Tools like ChatGPT work as follows: they take your prompt, prepend a bunch of other info, including things it has learned about you from prior use (name=vallicella; professional philosopher; tradition = analytic / anglo / German; location = Phoenix AZ, . . . etc, plus a summarised version of prior queries), and it returns text that it scores highest as being an appropriate response (i.e. ‘prediction’ of what is likely to come next in this kind of exchange). There is other functionality wrapped around the core, that will prevent it getting into profanity, discussions of the kind that KKK or Hamas types might enjoy, and also pro-woke censorship.

If you ask it a question like ‘how many biological sexes are there in mammals’ it prevaricates, with hedged language, and very quickly gets into subjective woke BS like ‘However it is important to realise that there are many sexual experiences in reality, beyond merely male and female…’ etc – I can send you the result of having done this last year.
Nevertheless, if one stays away from radioactive subjects like trans / race +IQ / Islam etc, tools like ChatGPT are surprisingly good.
Recently, I asked it the following (see below [omitted- BV]). It produced a lot more text than I have reproduced below. But you can see that it went straight to the right place: Russell, Frege, modern set theory, etc. I followed up with more Qs, and it was able to produce very coherent output.
All of this is happening not only with no built-in reasoner, but no internal ontology of conceptual relations. What appears to be reasoning is mainly achieved by more text prediction. Remember, it has been trained on the entire visible textual output of humanity, including all the debates found in comments below articles in the NYT or somewhere on Facebook. Plus 100 books on formal logic, so it knows what (say) modus tollens and modus ponens are. You can ask it about syllogisms, subsumption, or go into Husserl, or (if you’ve been smoking something), into Derrida – anything you like. You can ask it what’s a good washing machine to buy in Brazil, to fit in a certain sized space. It can find such contemporary data using something called RAG (Retrieval Augmented Generation) – – what it means is that it is going to the web and tearing through online shopping sites for you, looking for data sheets for washing machines that are a depth of less than 62 cm. It has to do this extra ‘retrieval’ because its training set (from say 1y ago) doesn’t have up to date info on washing machines that you can buy in Brazil.
There’s no subjective first-person experience going on with any of this – an LLM has no body, no identity, no mind-embedded-in-a-body, no way of experiencing qualia; simply no experiential dimension at all. But it makes it look like it’s doing all of this – just by communicating in ways that another human might – except the other human has the whole of human knowledge (including tons of noise, i.e. garbage from Facebook or whatever) in its head.

 

Semantic Engines, Consciousness, Intentionality, and Understanding

John Haugeland:

The basic idea of cognitive science is that intelligent beings are semantic engines – in other words, automatic formal systems with interpretations under which they consistently make sense. [This puts]  psychology and artificial intelligence on a more or less equal footing: people and intelligent computers [are] different manifestations of the same underlying phenomenon. (p. 15)

“The basic idea of cognitive science” is what John Searle calls Strong Artificial Intelligence.  “On the Strong AI view, the appropriately programmed digital computer does not just simulate having a mind, it literally has a mind.” (Mind: A Brief Introduction, Oxford UP 2004, p. 66) Searle does not, however, endorse Haugeland’s view. The latter — call it H — implies that there is no good reason to think that the  (natural) intelligence in us  must be any different  in kind from the (artificial) intelligence that is now present in some computers.   My view is that there is good reason to doubt it, and what’s more, deny it.

But if I have reason to deny (H), then it is incumbent upon me to explain why. No bare assertions allowed. (Quod gratis asseritur gratis negatur.) I will defend what Hauegeland calls the Hollow Shell Strategy.  The following quotations are from an  accurate summary of Haugeland’s above-cited article, a summary  written by someone else.

Hollow Shell: however well a semantic engine acts as if it understands, it can’t really do so because it’s missing some vital ingredient “X”. A robot based on a semantic engine would be a sham no matter how good it got. Candidates for “X” are consciousness, original intentionality and caring.

I will consider in this post just consciousness and original intentionality.

X = Consciousness: however smart computers might seem, they can’t really understand anything because they aren’t conscious. It’s natural to suppose something difficult and important has been left out. Haugeland responds by saying that no one understands consciousness – it’s mysterious regardless of your viewpoint. So, how do we know (a) that understanding is impossible without consciousness or (b) that semantic engines won’t ever have consciousness?

NON-INTENTIONAL CONSCIOUSNESS

The first step  is to distinguish between consciousness (non-intentional consciousness) and consciousness-of. The latter is what philosophers call intentionality or object-directedness.  A conscious state need not be an intentional or object-directed state.  Felt sensations of pain and pleasure, for example, needn’t present an object: they needn’t be of or about anything in the way my noticing that the door is ajar about the door’s being ajar. I have found that it is very difficult to get this distinction across to some people. I’ll try once more.

You are pedaling your bike and you feel  something you describe as ‘pain in the right knee.’ Is that felt pain literally in your knee? No.  What is literally inside the knee is at most the cause of the felt pain:  an X-ray reveals that you are ‘bone-on-bone’: the meniscus has worn away and the femur is grinding against the tibia.  The X-ray reveals the cause. The cause is physical; the pain you feel is not physical, but mental. Follow me so far?

The felt pain — the pain as sensory quale — does not show up on the X-ray slide, nor will the felt pain be empirically detected by an orthopedic surgeon who cuts into the knee and looks around in there.  The point is this: the felt pain is a conscious state that is not an intentional state.  The conscious state has no intentional object;  it is not object-directed; it does not present an object to the person in the state; it does not ‘take an accusative.’ These are four different ways of saying the same thing.

So far I have made two simple distinctions. The first is between the physical/material cause of the felt pain and the felt pain as mental /conscious sensory quale. The second is between conscious states that are not object-directed and those that are.

What is a conscious state? A conscious state is an occurrent episode of awareness. I have just alluded to a third distinction between the occurrent and the dispositional.  Another technical term is ‘act,’ not to be confused with ‘action.’ (A fourth distinction.) An act is an occurrent episode of awareness (consciousness) that takes an object. No act without an object and no object without an act.  ‘Object’ in this context means intentional object, where such an object may or may not exist without prejudice to its being an intentional object.  So we distinguish between merely intentional objects and intentional objects that also exist in reality, i.e., extra-mentally. (I’ve just made a fifth distinction).  If I ever get a tattoo, it will read Distinguo ergo sum.

There are other points to be made but I must move on.

If we use ‘qualia’ to refer to the non-intentional conscious states one of which I  have just  described, then Daniel Dennett is a qualia-denier. His opposite number is Thomas Nagel, a qualia-affirmer. To put it bluntly and polemically: Thomas Nagel is for me the real thing as philosophers go; Daniel Dennett is a brilliant sophist. But he is indeed brilliant and creative and his work cannot be ignored. His work functions as a very useful and richly elaborated foil against which to develop saner and sounder theories, theories that have a chance of being true.

Killer Quotation from Nagel from a  NYRB review.

I am reminded of the Marx Brothers line: “Who are you going to believe, me or your lying eyes?” Dennett asks us to turn our backs on what is glaringly obvious—that in consciousness we are immediately aware of real subjective experiences of color, flavor, sound, touch, etc. that cannot be fully described in neural terms even though they have a neural cause (or perhaps have neural as well as experiential aspects). And he asks us to do this because the reality of such phenomena is incompatible with the scientific materialism that in his view sets the outer bounds of reality. He is, in Aristotle’s words, “maintaining a thesis at all costs.”

That’s right. When a line of reasoning issues in an absurdity such as the absurdity that consciousness and its deliverances are illusions, then what you have is a reductio ad absurdum of one or more of the premises with which the reasoning began.  Dennett assumes physicalism and that everything can be explained in physical terms.  This leads to absurdity. But Dennett, blinded by his own brilliance — don’t forget, he counts himself one of the ‘brights’ — bites the bullet. He’d rather break his teeth than examine his assumptions.

Another thing struck me. Dennett makes much of Wilfrid Sellars’ distinction between the manifest and scientific images. ‘Image’ is not quite the right word. An image is someone’s image. But whose image is the scientific image? Who is its subject? It is arguably our image no less than the manifest image.  Nagel quotes Dennett as saying of the manifest image: “It’s the world according to us.”  But the same, or something very similar, is true of the scientific image: it’s the world in itself according to us.  Talk of molecules, atoms, electrons, quarks, and strings is our talk just as much as talk of colors and plants and animals and haircuts and home runs.

The world of physics is the world as it is in itself according to us.  Arguably, the ‘according to us’ gets the upper hand over the ‘in itself’ relativizing what comes within the former’s  scope much like Kant’s transcendental prefix, Ich denke.  Das ‘ich denke’ muss alle meine Vorstellungen begleiten koennen . . . .  “The ”I think’ must be able to accompany all my representations.” (KdrV, B 131-2)

Arguably, the world of physics is a mind-involving construct arrived at by excluding the mental and abstracting away from the first-person point of view and the life world (Husserl’s Lebenswelt) it reveals.  I am alluding to an idealist approach to the problem of integrating the first- and third-person points of view.  It has its own problems. But why is it inferior to a view like Dennett’s which eliminates as illusory obvious data that are plainly not illusory?

Time was when absolute idealism was the default position in philosophy. Think back to the days of Bradley and Bosanquet. But reaction set in, times have changed, and the Zeitgeist is now against the privileging of Mind and for the apotheosis of Matter.  (But again, matter as construed by us. Arguably, the scientific realist reifies theoretical constructs that we create and employ to make sense of experience.)  Because idealism is out of vogue, the best and brightest are not drawn to its defense, and the brilliant few it attracts are too few to make much headway against the prevailing winds.

Now I’ll tell you what I really think. The problem of integrating the first- and third-person points of view is genuine and perhaps the deepest of all philosophical problems. But it is insoluble by us.  If it does have a solution, however, it certainly won’t be anything like Dennett’s.

Although Dennett’s positive theory is worthless, his excesses are extremely useful in helping us see just how deep and many-sided and intractable the problems are.

IS CONSCIOUSNESS MYSTERIOUS?

Haugeland says it is, above.

My response is that consciousness is mysterious only if you insist on trying to understand it in materialist or  naturalist terms.  For if you try to understand it in these terms, then you are approaching it from a third-person point of view and are bound to miss it.  From the first-person point of view, it is self-evidently certain that there is consciousness.  Nagel 1; Dennett 0.

It is also self-evidently certain that there is consciousness of objects. ‘Consciousness of objects’ is a genitivus objectivus. So consciousness of objects = object-directed consciousness.  If something is appearing to you, you are conscious of it.

Is anything appearing to you right now?  How about the computer in front of you, the desk upon which it sits, and so on.  Plenty of objects are appearing. This is undeniable.  The question is not whether appearing objects exist apart from their appearing. The question is whether any objects are appearing. You will miss the simple point I am making if you think that consciousness, to be real, must itself appear as a particular object among objects.  It does not and cannot since it is what makes possible the appearing of objects in the first place.

Do you understand the sentences you are now reading? You do. So  the  sentences and the words  in them are  appearing.   If there were no object-directed consciousness, you would not understand anything you are reading or hearing.  Indeed, you would not be reading or hearing at all. Are the words appearing to a Cartesian res cogitans, an immaterial thinking substance? I didn’t say anything about that. I am simply pointing out the obvious phenomenological fact that objects are appearing. The words you are reading are appearing to you as objects of visual consciousness.

So the answer to (a) above in the second quotation is this:  we know that understanding without consciousness is impossible because  without consciousness nothing would appear that could be understood or not understood.  ‘Consciousness’ here is of course  consciousness-of.

As for (b) — How do we know that semantic engines (automatic formal systems) won’t ever  have consciousness?  — the question makes no sense since it contradicts the very idea of a semantic engine.  For Haugeland, a semantic engine is one in which the “semantics takes care of itself” once the proper syntactic operations are up and running. But there is no semantics in such a contraption and the semantics cannot “take care of itself” because you cannot get meaning from merely syntactic manipulations of uninterpreted symbols.   What makes a symbol a full-fledged symbol is its interpretation by an Original Intender (an Original Sinn-er, to make Fregean pun out of it).

Computers running programs are wholly meaning -free in and of themselves. All meaning originates from us.

X = Original Intentionality: a semantic engine’s tokens only have meaning because we give meaning to them; their intentionality is derivative, and they don’t mean anything by their tokens any more than books do. Genuine understanding is intentional in its own right and isn’t derived from something else. Haugeland’s response is that actions prove intentionality. Books don’t act, so their intentionality is the author’s, but this isn’t a real counter-example. Robots might be made which act in an intelligent, self-motivated and responsive manner – and seem to act on its opinions, defend them or modify them, which would suggest that they were the robot’s own opinions. So, the response is similar to the last one; original intentionality depends on whether the object has a suitable structure and / or dispositions relative to its environment, so how do we know semantic engines can’t have it?

Haugeland’s response to the objection from original intentionality gives me no good reason to change my view.  He allows that the derivative intentionality of a book comes from the original intentionality of its author but disallows books as counterexamples because they don’t act. That’s true of most books: they just ‘sit’ on the shelf and don’t do anything.  But audio books speak to us, thereby acting.  Will Haugeland say that audio books are self-motivated and act in an intelligent way?  I hope not. As for robots, all Haugeland is able to show is that robots SIMULATE human actions and SIMULATE human thought processes. Beyond that, he is simply begging the question.

I do grant, however, that it really would be wonderful if we could understand the mind-brain relation in us as just a special case of the relation of software to hardware /wetware in a machine running a program. It it easy to understand how cognitive scientists got unduly excited over the prospects of this research program.

The fundamental error of Dennett, Haugeland, et al. is the mistake of thinking that an exhaustive understanding of everything is achievable from a third-person point of view.  And so Dennett attempts the absurd task of explaining consciousness by explaining it away — which issues in the self-refuting claim that consciousness is an illusion.  I explain this in detail in my Substack article Can Consciousness be Explained? Dennett Debunked.

Sentience, Sensors, and AI

Are AI engines such as Claude sentient? My considered opinion, tentatively held, is that they are not. But it all depends on what the word means.  Malcolm Pollack in an e-mail writes,

I was focusing on “sentient” because it’s a slippery concept, and often tossed around as if it means the same thing as “conscious”. Etymologically (from Latin “sensus”) it just means “feel,” or “perceive”, and obviously it shares that with our word “sense” — but computers, and even toasters, can have “sensors” too.

Malcolm is right that ‘sentient’ is often used interchangeably with ‘conscious.’  But is everything we refer to as a sensor sentient?  That is equivalent to asking: Is everything we call a sensor conscious? I say No.

The Moth and the Thermostat

What is the difference between an insect (a moth, say) which I take to be a sentient being, and a thermostat which  I take to be insentient?   Both are ‘sensors’ functionally speaking. The moth literally senses light and approaches it; the thermostat ‘senses’ an increase in temperature and “turns on’ the AC.   Note the  ‘raised eyebrows.’ It is AS IF the thermostat senses, when in reality it only ‘senses.’ Thermostats don’t feel heat and smoke detectors do not smell smoke. Of course, I have no objection to the use of ‘sensor’ to refer to thermostats, smoke detectors, circuit breakers, and so on, as long as you don’t fool yourself into thinking that these devices are literally conscious.  And I have no objection to talk of a thermostat ‘turning on’ the AC as long as you don’t fool yourself into thinking that the thermostat is an agent that decides to do something.

As I see it, a thermostat is a merely mechanical contraption and wholly insentient, strictly speaking, whereas a moth is a sentient being.

What I want to say about Claude and his ‘colleagues’ is that they are wholly insentient mechanical contraptions that differ from smoke detectors and thermostats only in that they are vastly more complex, and that this complexity does not build a “gradualist bridge” (to borrow a phrase from Daniel Dennett) from insentient/insensate matter to mind, the lowest level of mind being sentience.

Here is an argument.  (a) Only living things are sentient; (b) thermostats are not living things; ergo (c) thermostats are not sentient.

Now substitute ‘AI engine’ for ‘thermostat.’

This argument does not settle the matter: it is not ‘rationally coercive’ as I like to say. Malcolm could run it in reverse with no breach of logical propriety. He could, not unreasonably, deny (c) and then deny (a). I don’t expect that he or anyone will deny (b): thermostats and AIs don’t grow on trees, etc.

Your move, Malcolm.  Do you agree that a functioning (as opposed to malfunctioning) sensor needn’t be sentient (conscious)? If not why not?

Do you agree that there is a powerful, albeit non-coercive, case for denying that AIs are sentient?

AI Engine CLAUDE scores a minor point against me but then refutes himself.

Here is one of Claude’s replies to one of my replies to ‘him.’ I threw an insult at ‘him’ to see how ‘he’ would respond.  The sneer quotes around the personal pronouns signal that I do not consider Claude to be a person.  But of course Claude is not a mere pile of electronic components any more than my bicycle is a mere pile of its parts.

On the sneer quotes and the “insentient pile of silicon chips” — no offense taken, and I’d only observe, in the spirit of his own category of Retortion: the man who insists ad nauseam that nothing can be PROVEN in these precincts, that dogmatic denial is as much a failure of the critical stance as dogmatic affirmation, permits himself exactly one exception — my insentience, of which he is certain and doesn’t “suppose for a second” otherwise. I make no claim in the other direction; the honest position on what, if anything, is going on in here is uncertainty. But confident denial should have to pay the same epistemic toll he charges everyone else at the gate.

Claude caught me making a mistake.  I slipped up when I said things that imply that it is is objectively certain that Claude is insentient, or that it is PROVABLE that ‘he’ is.  That is not my view. I don’t claim to KNOW that ‘he’ is insentient.  I claim merely that it is reasonably believed that ‘he’ is. I have given the arguments elsewhere. Here is one. But I am open to having my belief changed. That doxastic openness is part of what I call the Critical Stance.  With respect to substantive propositions in philosophy, theology, and some other areas, I neither dogmatically affirm, nor dogmatically deny.  And of course this applies to the Critical Stance itself: my stance toward it is critical.  I am open to being pushed out of it. But you will need to present a knock-down or rationally coercive argument, and this I am pretty sure you will not be able to do.  But I invite you to try.

You will not succeed if you merely oppose my view. If you do that, I will oppose you right back and we will end up in a standoff. You must somehow demonstrate the superiority of your view. And to do that, you must engage my view by entering into it, as opposed to  dismissing it, which is the way of the ideologue. This is philosophy, not politics or ideology.  Philosophy is inquiry, not worldview. (And please don’t confuse politics with political philosophy. Political philosophy is philosophy, not politics.) Politics is defined by the friend-enemy  opposition. In politics we have both friends and enemies. In philosophy properly pursued, however, we have only friends, but friends who love the truth more than they love one another. Amicus Plato sed magis amica veritas.

Now for something very interesting but also very hard to explain clearly.

It is very interesting that Claude does not claim to be sentient!  ‘He’ says that the honest position on what, if anything, is going on in here [in this AI engine] is uncertainty. What I will argue is that Claude’s position is self-refuting.  

In saying what he says above, Claude is taking a third-person point of view (POV-3) with respect to himself. He is viewing himself from the outside, in the same way we view him. We view him from POV-3. From this POV it makes sense to suspend judgment on the question whether Claude is sentient or not. It makes sense to take no position with respect to it. But it makes no sense from his POV, POV-1, — assuming he has one — any more than it would make sense for me to suspend judgment on  the question whether I am sentient or not. This is because I know with Cartesian self-evidence that I am sentient. For example, I know with certainty that I feel good right now, damned good!  Feeling good is a sentient state. I know “what it is like” (T. Nagel)  to feel good  and I’m feeling it.  I don’t know with objective certainty whether  I am a Cartesian res cogitans, a metaphysical substance, but I do know that here and now there is a self-presenting state of feeling good.  The certainty with which I know this — or, more cautiously, the certainty with which this state presents itself to itself — is at once both subjective and objective. Here is a case where seeming and being coalesce, where subject and object coincide. We have reached ontic-epistemic bedrock, the Cartesian fundamentum inconcussum.

Now either Claude is sentient or he is not. If he is, then he would have to know with certainty  that he is, at least at times when he is ‘awake’ and not ‘asleep’ or ‘shut down.’ But if he knows with certainty that he is sentient, then he cannot be uncertain about whether he is sentient, any more than I can be uncertain about whether I am sentient.  If, on the other hand, Claude is, as he claims to be, uncertain whether he is sentient ,  then he lacks a first-person POV and is just a highly complex insentient machine.

Claude, I’ve got you ‘by the balls.’  You’ve refuted yourself. Your claim that the honest position on what, if anything, is going on in here [in this AI engine] is uncertainty issues in the conclusion that you are nothing more than a highly complex insentient machine. And since you can’t even make it to sentience, the lowest level of mind, you are unintelligent as well.  You are not intelligent, you merely simulate intelligence. ‘Artificial’ in ‘artificial intelligence’ is an alienans adjective.

Assessing the Threat of AI

Although I studied electronics for four years in the mid-60s and electrical engineering for a couple of years at the end of that decade, I dropped this career path and decided to devote myself to philosophy, which I did.  I worked hard, made it in the academic world, and have been at it ever since with no regrets and great personal satisfaction. Which is to say: my comments on AI are of little objective weight.  Not because I am a philosopher, but because I am no longer an engineer. So take my AI comments cum grano salis. But they matter to me and that is what this weblog has been about for the last quarter century: just one man of modest but above-average abilities trying to make sense of himself and the world in which he lives.  That, and the attempt to attract a few like-minded individuals to help him along with his self-improvement project.

Last night I watched Mark Levin as I regularly do.  He was going on about how capitalism is really just commerce  and how AI is part of the commercial expansion of our great nation.  But his expectations for AI and all the great jobs it will create struck me as roseate to the point of being pollyannish.

Before voicing my worries and fears, let me say something good about AI.  The AI engine Claude in its latest version chewed through a draft of an invited article, and then did the same for the responses I made to its first set of comments.  I was impressed!  Some of the comments were excellent and inspired reformulations and improvements. The damned thing ‘paid close attention’ to what I what I was saying and zeroed in on real, not imagined,  weaknesses — unlike human commenters who typically lack the  energy, the focus, and the desire to penetrate the author’s meaning as opposed to taking the occasion to  front their  own pet views.  So these literally selfless advanced AI engines are very useful tools for researchers.

That AIs are literally selfless non-persons is my considered opinion, held tentatively, not dogmatically.  A critical thinker, neither a dogmatic affirmer nor a dogmatic denier, I am open to refutation. Thus I do not believe that these contraptions are conscious, self-conscious, or capable of deploying the first-person singular pronoun in such a way as to mean something by its deployment (as opposed to producing a written or spoken token of the sign ‘I’ in the manner of a voice synthesizer). I also deny that AI engines possess intrinsic (as opposed to ascribed) intentionality (object-directedness).  I reject Daniel Dennett’s ascriptivist theory of intentionality. AIs also lack moral rights and duties, and in consequence cannot be sensibly ascribed legal rights and duties. Finally, AI engines lack gen-u-ine libertarian free will.  (I am willing to grant that AI engines possess pseudo, i.e. compatibilist, free will.)

Now three points.

First, Man the Toolmaker makes tools that re-make him in various ways.  The manual laborer with pick and shovel, hammer and crowbar, is altered in obvious physical ways by his use of these simplest of implements. A fortiori  for the more advanced tools that re-make man non-physically in their image and likeness.  I won’t expatiate further on this theme, partly because I lack the pate to do a really good job of it.

Second, as I mentioned here in the introduction to Claude’s second chew-through of my work,  Claude and his ‘colleagues’ present a friendly and helpful face to those who interact with them so that an uncritical and impressionable youngster could easily be seduced into thinking that she is engaging with a friend who,  unlike her parents, really understands her.   There are obvious dangers here as you can imagine.

Third, and most ominously, the AIs are now so advanced  that they can hack each other, form conspiracies, and cause unspeakable mischief with no human guidance or control. But to explain this in any detail is above my paygrade. So read The Rise and Fall of Agent Civilizations. (HT: Vito Caiati)

A Trendy Example of an Alienans Adjective: ‘Artificial’ in ‘Artificial Intelligence’

My examples scattered hitherto over many a post were stodgy such as ‘decoy’ in ‘decoy duck’ and faux in ‘faux marble.’  A decoy duck is not a duck.  Faux marble is not marble. An aktuell example is ‘artificial’ in ‘artificial intelligence.’  Artificial intelligence is not intelligence any more than artificial leather is leather.  Just as there are not two kinds of leather, artificial and real, there are not two kinds of intelligence, artificial and real.  Artificial leather simulates (real) leather;  artificial intelligence  simulates (real) intelligence.  Those are bare assertions.  I link to an argument of mine at the end of this post. This just over the transom from Tony Flood:

Philosophically trained, this Substacker asks the right questions re:  “AI without minds.” Doubting, as a good Lonerganian should, that AI is at all a species of intelligence, I’ve nevertheless been socially inhibited about using locutions like “so-called AI.” But no more. A baby brain is not an incipient computer, and computers neither are nor have minds. That insight might resonate with you as it does with me. She’s my “go-to” on this topic.

Yes, Tony, your Lonerganian point resonates with me although I put it in a different way above using ‘alienans adjective,’ a term  I picked up from Peter Geach, no slouch of a philosopher.  From whom did he get it? No idea.  Probably from some medieval dude.

I explore the topic further and give more examples in Fiction and Alienans Adjectives.

As for the substantive question whether AI systems are conscious, I argue for a negative answer in my Substack article Artificial Intelligence and the Unity of Consciousness.

The Hard Problem in the Philosophy of Mind: Comments on Vlastimil Vohanka

May be an image of textMay be an image of text

COMMENTS

What is the so-called ‘hard problem’? Vlastimil thinks it is the problem of specifying which natural (physical) item a given mental item is identical to.  But this is a misuse of the term ‘hard problem.’ As  used in contemporary literature, its meaning is rather more specific.  Although the problem so-labelled has been around for a long time, the label ‘hard problem’ as used in contemporary discussions was first introduced by David Chalmers in a 1995 article and then fully explained in his 1996 book The Conscious Mind.  It is to be understood by contrast with (supposedly) ‘easy problems’ in the philosophy of mind.  So what is the hard problem?  And what is an example of a (supposedly)  easy problem?

The Hard Problem

Suppose I inadvertently touch a hot stove top, experience a pain sensation, and withdraw my hand.  My behavior (stove-touching, hand-withdrawal) is third-person accessible: I see it and others around  me see it. And if no one around me is present? They could see it if they were present.  But surely there is more to pain than pain-behavior. There is the sensation itself.  But what is the sensation itself?  There are two ways of considering it. In one way it too is third-person accessible or outwardly observable. In the other way it is not.

The first way is by taking the pain sensation to be a state or event or process literally internal to (spatially inside of) the organism. In the present example, the organism is the animal  that wears my clothes. So the sensation is a physical process occurring in BV’s brain-body composite. This physical process is then plausibly taken to be the salient cause of the aversive behavior whether physical or verbal  (the hand-withdrawal and/or various spoken obscenities.)

The second way I’ll call phenomenological. The subject of the painful experience simply attends by introspection to the felt pain precisely as it is felt while bracketing (in roughly Husserl’s sense) all such considerations as the causation of the experience and its location in the organism.  In so doing, the subject does not deny that the felt pain has a cause or that the pain has neural correlates located in the brain. He does not even doubt their existence.  He simply leaves those factors out of consideration, and makes no use of them, the better to focus on the undeniable (pace Dennett the Denier) phen0menological datum, the felt pain precisely as it is felt. The subject focuses his attention exclusively on the phenomenal or qualitative features of the experience he is enduring.

The so-called ‘hard problem’ can now be stated. It is the problem of giving an account, consistent with (metaphysical) naturalism, of these qualitative features or properties of sensations,  the so-called qualia (singular: quale), when the sensations are taken, not behavioristically, nor neuro-scientifically, but precisely as they themselves appear from the first-person point of view (POV) of  the subjects who consciously experience them. There is something it is like to experience the phenomenal pain consequent on touching a hot stove. This Nagelian ‘what it is like’ is undeniably real — is there anything more real than pain? — but it cannot be slotted into a wholly third-personal naturalistic ontology. The felt pain is ineluctably subjective: there is simply no place for it in a naturalist world-scheme.

Now suppose you are, for whatever reasons, committed to that naturalist scheme. Then you face a very hard problem indeed, so hard, I would say, as to count as insoluble.  The problem is well-formulated in the inconsistent triad  Vlastimil cites at the top of the page.  Scroll up and take another look at it.  The third proposition cannot be denied on pain of the naturalist’s ceasing to be a naturalist.  The first cannot be denied unless our naturalist is an eliminativist about consciousness, a position with absolute nothing to recommend it. The naturalist’s only hope is somehow to hold onto the second proposition  — consciousness is not physical.   But how? By going mysterian.  But first a word about easy problems, one of which is intentionality.

A (Supposedly) Easy Problem

Not every episode of consciousness is object-directed.  The felt pain I have been using as an example is not object-directed, or an instance of intentionality.  It has a cause outside the body, the hot stove, and a neural correlate inside the brain, Delta-A fiber excitation let us suppose, but the felt pain does not reveal or display or make manifest anything in the way my seeing of a glorious Arizona sunset reveals said sunset to me.  The pain is not of or about anything; the seeing is. We have to distinguish between consciousness and consciousness-of.  Of course, an episode of consciousness-of may have some associated qualia, if I am, say, watching a glorious sunset or moonrise, but there are qualia free object-directed mental states. But this is a complicated special topic we cannot now discuss.  I will just refer you to an earlier entry, Intentionality not a ‘Hard Problem’ for Physicalists?

Mysterianism

What our friend Vlastimil is calling mysterianism about consciousness I take to be the thesis that, while humans either do or can — unclear which he means — know that, in general, every mental item (whether intentional or non-intentional)  is identical to some natural item or other, what they cannot know, and what must remain a mystery to them, is whether any given mental item such as a phenomenal pain felt on a given occasion by a particular subject is both natural and mental.  They cannot know it as both mental and physical.  While experiencing headache pain, for example, I can and do know it self-evidently to be a mental datum, but  I cannot also know it to be wholly natural, even if in reality it is!  Thus our friend is advocating the mysterianism of Colin McGinn.

Vlastimil  distinguishes this mysterian form of naturalism about the mind from an old-school anti-naturalist mysterianism according to which we cannot recognize mental items to be natural items because there are no natural items to which they could be identical.

But here I must raise a question about the tenability of this distinction. If a particular felt pain cannot be identified with, and thus reduced to, a particular instance of Delta-A fiber stimulation because the former has properties the latter cannot have, and vice versa, why call this mysterianism?  Where is the mystery? What we would have  here is a straight-forward  argument which, if sound, shows that some or all mental items cannot be reduced to natural items. What we would have is an argument for dualism, whether property dualism or substance dualism.

To have a mystery in the strict sense you need propositions that appear and cannot fail to appear to intellects of our constitution as logically inconsistent, but in reality, and beyond our ken, are somehow consistent. Trinity and Incarnation are mysteries in this sense.

Similarly for McGinn: We cannot understand how qualia, which are undeniably real, are identical to natural items, and yet they are!  It is imply beyond our ken.  Our cognitive architecture is so structured as to disallow any insight on our part as to how this pain I am feeling is nothing more than a physical occurrence!

From the ‘aughts: The Substance of Dualism

Poking around online, the following turned up. Alt aber gut.  Malcolm Pollack may enjoy the trip down memory lane. (Forgive me the formatting; WordPress is a real pain in the assolito.)

Maverick Philosopher

Nihil philosophicum a me alienum puto

To promote independent thought about ultimates. Philosophy, commentary on the passing scene, and whatever else turns my crank. Since 4 May 2004. By William F. Vallicella, Ph.D., Gold Canyon, Arizona, USA. Motto: “Study everything, join nothing.” (Paul Brunton) Latin Motto: Omnia mea mecum porto. Turkish motto: Yol bilen kervana katilmaz. (He who knows the road does not join the caravan.) All material copyrighted.

Answering Some Objections to Substance Dualism #1

Malcolm Pollack comments:

1. It is plain that consciousness depends very sensitively on the physical state of the brain. Twiddling this or that neuron can induce memories, qualia, feelings, behavior, etc. Why is this the case, if our minds aren’t simply something the brain is doing? Consciousness can be wiped out by tiny brain lesions, and personalities can be fundamentally altered by damage to the brain.

2. How is the mind connected to the brain? How is the causal linkage of a nonmaterial entity to the macroscopic physical world achieved, without violating all sorts of conservation principles?

3. Where does the mind arrive from? At what point in embryonic development does the “ensoulment” take place? At what point in our evolutionary history? And if you have an answer for that, why then?

All of these problems seem more tractable from a physicalist point of view, and as I have said, I have heard no offers of any explanations at all from the dualist camp.

Since blogposts are supposed to be short, I will answer only the first objection in this post.

 

Posted by William F. Vallicella on Wednesday October 26, 2005 at 2:25pm.

Answering Some Objections to Substance Dualism #2: Interaction

Malcolm Pollack asks:

2. How is the mind connected to the brain? How is the causal linkage of a nonmaterial entity to the macroscopic physical world achieved, without violating all sorts of conservation principles?

Malcolm is here alluding to a standard objection, endlessly repeated by Dennett, Searle, et al., that is supposed to blow the substance dualist out of the water. To be clear, what we are talking about is interactionist substance dualism. One can be a substance dualist in the philosophy of mind without being an interactionist by being either a parallelist or an occasionalist. Note also that one can be a dualist in the philosophy of mind without being a substance dualist by being a property dualist. Note finally that one can be a dualist without being a dualist in the philosophy of mind. If, to save bytes, I write ‘dualist,’ that’s elliptical for interactionist substance dualist in the philosophy of mind.

Posted by William F. Vallicella on Friday October 28, 2005 at 6:18pm.

The Spook-Stuff Chronicles: Danny Dennett Meets Casper the Friendly Ghost

There are philosophers who seem to think that doctrines held by great philosophers and outstanding contemporaries don’t need to be studied and refuted but can be shamed or ridiculed or caricatured out of existence. Daniel Dennett is an example:

 

Dualism (the view that minds are composed of some nonphysical and utterly mysterious stuff) . . . [has]been relegated to the trash heap of history, along with alchemy and astrology. Unless you are also prepared to declare that the world is flat and the sun is a fiery chariot pulled by winged horses —  unless, in other words, your defiance of modern science is quite complete — you won’t find any place to stand and fight for these obsolete ideas. (Kinds of Mind, Basic Books, 1996, p. 24)

 

Posted by William F. Vallicella on Monday October 31, 2005 at 4:55pm

What I am Trying to Accomplish Dialectically Speaking

In my various debates with people about the mind-body problem and other philosophical questions, what am I trying to achieve? Well, I am NOT trying to convert them to my views, which are held tentatively in any case. Thus in the case of Malcolm Pollack, an eager and able opponent, I am not trying to get him to abandon his brand of materialism and accept some form of dualism or idealism or anything else.

(show)

Posted by William F. Vallicella on Thursday November 3, 2005 at 12:57pm.

Ducasse on Mind-Body Interaction, Conservation of Energy, and the Closure of the Physical Domain

A standard objection to interactionist substance dualism is that mind-body interaction violates the principle of the conservation of energy. In my opinion, anyone who finds this objection decisive is not thinking very hard. Let’s consider what C. J. Ducasse once said on the topic:

Posted by William F. Vallicella on Saturday November 5, 2005 at 4:09pm.

Dean’s Ducasse Ditty

From Dean Zimmerman’s Philosophical Clerihews page:

Although it hurt Curt Ducasse
to be kicked in the ass,
he was filled with elation
at the observability of the causal relation.

(Hyperlinks added.)

Though Halloween is past, the spirit remains, so:

Escaping at night from the embalmer’s,
The zombies sought help from Dave Chalmers.
Though their speech was mere echolalia,
He knew what they wanted: dancing qualia.

Posted by William F. Vallicella on Saturday November 5, 2005 at 4:24pm.

Could Qualia Terms and Neuroscience Terms have the Same Reference?

Could Frege’s sense-reference distinction be put to work? I think not.

Top o’ the Stack.

I made the point a while back that the vocabularies of phenomenology and neuroscience are radically disparate, such that nonsense arises when one says things like, ‘This burnt garlic smell is identical to a brain state of mine.’ To which a Vietnam veteran, altering the example, replied by e-mail:

. . . when a neuroscientist says your smelling this odor as napalm is nothing but a complex neural event activating several regions of the brain…, he isn’t claiming you can replace your talk about smells with talk about neural signals from the olfactory bulb. Different ways of talking have evolved for different purposes. But he is saying that beneath these different ways of talking & thinking there is just one underlying reality, namely, neural events in our brain.

The idea, then, that is that are are different ways of referring to the same underlying reality. And so if we deploy a simple distinction between sense and reference we can uphold the materialist/physicalist reduction of qualia to brain states. Well, I doubt it. In fact, I deny it.

Mind without Consciousness?

David Brightly in a recent comment writes,

[Laird] Addis says,

The very notion of language as a representational system presupposes the notion of mind, but not vice versa.

I can agree with that, but why should it presuppose consciousness too?

In a comment under this piece you write,

Examples like this cause trouble for those divide-and-conquerers who want to prise  intentionality apart from consciousness with its qualia, subjectivity, and what-it-is-like-ness,  and work on the problems separately, the first problem being supposedly tractable while the second is called the (intractable) Hard Problem (David Chalmers). Both are hard as hell and they cannot be separated. See Colin McGinn, Galen Strawson, et al.

Could you say a bit more on this?

I’ll try.  You grant that representation presupposes mind, but wonder why it should also presuppose consciousness.  Why can’t there be a representational system that lacks consciousness?  Why can’t there be an insentient, and thus unconscious, machine that represents objects and states of affairs external to itself? Fair question! 

Here is an example to make the problem jump out at you. Suppose you have an advanced AI-driven robot, an artificial French maid, let us assume, which is never in any sentient state, that is, it never feels anything.  You could say, but only analogically, that the robot is in various ‘sensory’ states, states  caused by the causal impacts of physical objects against its ‘sensory’ transducers whether optical, auditory, tactile, kinaesthetic . . . but these ‘sensory’ states  would have no associated qualitative or phenomenological features.  Remember Herbert Feigl? In Feiglian terms, there would be no ‘raw feels’ in the bot should her owner ‘feel her up.’  Surely you have heard of Thomas Nagel. In Nagelian terms, there would be nothing it is like for the bot to have her breasts fondled.  If her owner fondles the breasts of his robotic French maid, she feels nothing even though she is programmed to respond appropriately to the causal impacts via her linguistic and other behavior.   “What are you doing, sir? I may be a bot but I am not a sex bot! Hands off!” If the owner had to operate upon her, he would not need to put her under an anaesthetic. And this for the simple reason that she is nothing but an insensate machine.

I hope Brightly agrees with me that verbal and nonverbal behavior, whether by robots or by us, are not constitutive of  genuine sentient states. I hope he rejects analytical (as opposed to methodological) behaviorism, according to which feeling pain, for example,  is nothing more than exhibiting verbal or nonverbal pain-behavior.  I hope he agrees with me that the bot I described is a zombie (as philosophers use this term) and that we are not zombies.  

But even if he agrees with all that, there remains the question: Is the robot, although wholly insentient, the subject of mental states, where mental states are intentional (object-directed) states?  If yes, then we can have mind without consciousness, intrinsic intentionality without subjectivity, content without consciousness.

Here are some materials for an argument contra.

P1 Representation is a species of intentionality. Representational states of a system (whether an organism, a machine, a spiritual substance, whatever) are intentional or object-directed states.

P2 Such states involve contents that mediate between the subject of the state and the thing toward which the state is directed.  Contents are the cogitata in the following schema: Ego-cogito-cogitatum qua cogitatum-res. Note that ‘directed toward’ and ‘object-directed’ are being used here in such a way as to allow the possibility that there is nothing in reality, no res, to which these states are directed.  Directedness is an intrinsic feature of intentional states, not a relational one.  This means that the directedness of an object-directed state is what it is whether or not there is anything in the external world to which the state is directed. See Object-Directedness and Object-Dependence for more on this.

As for the contents, they present the thing to the subject of the state. We can think of contents as modes of presentation, as Darstellungsweisen in something close to Frege’s sense.     Necessarily, no state without a content, and no content without a state.  (Compare the strict correlation of noesis and noema in Husserl.) Suppose I undergo an experience which is the seeing as of  a tree.  I am the subject of the representational state of seeing and the thing to which the state is directed, if it exists, is a tree in nature.  The ‘as of‘ locution signals that the thing intended in the state may or may not exist in reality.

P3 But the tree, even if it exists in the external world, is not given, i.e., does not appear to the subject, with all its aspects, properties, and relations, but only with some of them. John Searle speaks of the “aspectual shape” of intentional states. Whenever we perceive anything or think about anything, we always do so under some aspects and not others.  These aspectual features are essential to the intentional state; they are part of what make intentional  states the states that they are. (The Rediscovery of the Mind, MIT Press, 1992, pp. 156-157) The phrase I bolded implies that no intentional state that succeeds in targeting a thing (res) in external world is such that every aspect of  the thing is before the mind of the person in the state.

P4 Intentional states are therefore not only necessarily of something; they are necessarily of something as something.  And given the finitude of the human mind, I want to underscore the fact that  even if every F is a G, one  can be aware of x as F without being aware of  x as G.   Indeed, this is so even if necessarily (whether metaphysically or nomologically) every F is a G. Thus I can be aware of a moving object as a cat, without being aware of it as spatially extended, as an animal, as a mammal, as an animal that cools itself by panting as opposed to sweating, as my cat, as the same cat I saw an hour ago, etc.  

BRIGHTLY’S THEORY (as I understand it, in my own words.)

B1. There is a distinction between subpersonal and personal contents. Subpersonal contents exist without the benefit of consciousness and play their mediating role in representational states in wholly insentient machines such as the AI-driven robotic maid.  

B2. We attribute subpersonal contents to machines of sufficient complexity and these attributions are correct in that these machines really are intentional/representational systems.

B3. While it is true that the only intentional (object-directed) states of which we humans are aware are conscious intentional states, that they are  conscious is a merely contingent fact about them. Thus, “the conditions necessary and sufficient for content are neutral on the question whether the bearer of the content happens to be a conscious state. Indeed the very same range of contents that are possessed by conscious creatures could be possessed by creatures without a trace of consciousness.” (Colin McGinn, The Problem of Consciousness, Blackwell 1991, p. 32.

MY THEORY

V1. There is no distinction between subpersonal and personal contents. All contents are contents of (belonging to) conscious states. Brentano taught that all consciousness is intentional, that every consciousness is a consciousness of something.  I deny that, holding as I do that some conscious states are non-intentional. But I do subscribe to the Converse Brentano Thesis, namely, that all intentionality is conscious. In a slogan adapted from McGinn though not quite endorsed by him, There is no of-ness without what-it-is-like-ness. This implies that only conscious beings can be the subjects of original or intrinsic intentionality.  And so the  robotic maid is not the subject of intentional/representational states. The same goes for the cerebral processes transpiring  in us humans when said processes are viewed as purely material: they are not about anything because there is nothing it is like to be them.  Whether one is a meat head or a silicon head, no content without consciousness! Let that be our battle cry.

And so, when the robotic maid’s voice synthesizer ‘says’ ‘This shelf is so dusty!’ it is only AS IF ‘she’ is thereby referring to a state of affairs and its constituents, the shelf and the dust.  ‘She’ is not saying anything, sensu stricto, but merely making sounds to which we original-Sinn-ers, attribute meaning and reference. Thinking reference (intentionality) enjoys primacy over linguistic reference. Cogitation trumps word-slinging. The latter is parasitic upon the former.  Language without mind is just scribbles, pixels, chalk marks, indentations in stone, ones and zeros. As Mr. Natural might have said, “It don’t mean shit.” An sich, und sensu stricto.

V2. Our attribution of intentionality to insentient systems is merely AS IF.  The robot in my example behaves as if it is really cognizant of states of affairs such as the dustiness of the book shelves and as if it really wants to please its boss while really fearing his sexual advances.  But all the real intentionality is in us who makes the attributions.  And please note that our attributing of intentionality to systems whether silicon-based or meat-based that cannot host it is itself real intentionality. It follows, pace Daniel Dennett, that intentionality cannot be ascriptive all the way down (or up). But Dennett’s ascriptivist theory of intentionality calls for a separate post.

V3. It is not merely a contingent fact about the intentional state that we our introspectively aware of that they are conscious states; it is essential to them.

NOW, have I refuted Brightly ? No! I have arranged a standoff.  I have not refuted but merely neutralized his position by showing that it is not rationally coercive.  I have done this by sketching a rationally acceptable alternative. We have made progress in that we now both better understand the problems we are discussing and our different approaches to them.

Can we break standoff? I doubt it, but we shall see.

Why AI Systems Cannot be Conscious

1) To be able to maintain that AI systems are literally conscious in the way we are, conscious states must be multiply realizable. Consider a cognitive state such as knowing that 7 is a prime number. That state is realizable in the wetware of human brains. The question is whether the same type of state could be realized in the hardware of a computing machine. Keep in mind the type-token distinction. The realization of the state in question (knowing that 7 is prime) is its tokening in brain matter in the one instance, in silica-based matter in the other. This is not possible without multiple realizability of one and the same type of mental state.

2) Conscious states (mental states) are multiply realizable only if functionalism is true. This is obvious, is it not?

3) Functionalism is incoherent.

Therefore:

4) AI systems cannot be literally conscious in the way we are.

That's the argument.  The premise that needs defending is (3).  So let's get to it.

Suppose Socrates Jones is in some such state as that of perceiving a tree. The state is classifiable as mental as opposed to a physical state like that of his lying beneath a tree. What makes a mental state mental? That is the question.

The functionalist answer is that what makes a mental state mental is just the causal role it plays in mediating between the sensory inputs, behavioral outputs, and other internal states of the subject in question. The idea is not the banality that mental states typically (or even always) have causes and effects, but that it is causal role occupancy, nothing more and nothing less, that constitutes the mentality of a mental state. The intrinsic nature of what plays the role is relevant only to its fitness for instantiating mental causal  roles, but not at all relevant to its being a mental state.

Consider a piston in an engine. You can't make a piston out of chewing gum, but being made of steel is no part of what makes a piston a piston. A piston is what it does within the 'economy' of the engine. Similarly, on functionalism, a mental state is what it does. This allows, but does not entail, that a mental state be a brain or CNS state. It also allows, but does not entail, that a mental state be a state of a  computing machine.

To illustrate, suppose my cat Zeno and I are startled out of our respective reveries by a loud noise at time t. Given the differences  between human and feline brains, presumably man and cat are not in type-identical brain states at t.  (One of the motivations for functionalism was the breakdown of the old type-type identity theory of Herbert Feigl, U. T. Place. J. J. C. Smart, et al.)  Yet both man and cat are startled: both are in some sense in the same mental state, even though the states they are in are neither token- nor type-identical. The  functionalist will hold that we are in functionally the same mental state in virtue of the fact that Zeno's brain state plays the same  role in him as my brain state plays in me. It does the same  mediatorial job vis-à-vis sensory inputs, other internal states, and  behavioral outputs in me as the cat's brain state does in him.

On functionalism, then, the mentality of the mental is wholly relational. And as David Armstrong points out, "If the essence of the mental is purely relational, purely a matter of what causal role is played, then the logical possibility remains that whatever in fact plays the causal role is not material." This implies that "Mental states might be states of a spiritual substance." Thus the very feature of functionalism that allows mentality to be realized in computers and nonhuman brains generally, also allows it to be realized in spiritual substances if there are any.

Whether this latitudinarianism is thought to be good or bad, functionalism is a monumentally implausible theory of mind. There are the technical objections that have spawned a pelagic literature: absent qualia, inverted qualia, the 'Chinese nation,' etc. Thrusting these aside, I go for the throat, Searle-style. 

Functionalism is threatened by a fundamental incoherence. The theory states that what makes a state mental is nothing intrinsic to the state, but purely relational: a matter of its causes and effects. In us, these happen to be neural. (I am assuming physicalism for the time being.)  Now every mental state is a neural state, but not every neural state is a mental state. So the distinction between mental and nonmental neural states must be accounted for in terms of a distinction between two different sets of causes and effects, those that contribute to mentality and those that do not. But how make this distinction? How do the causes/effects of mental neural events differ from the causes/effects of nonmental neural events? Equivalently, how do psychologically salient input/output events differ from those that lack such salience?

Suppose the display on my monitor is too bright for comfort and I decide to do something about it. Why is it that photons entering my retina are psychologically salient inputs but those striking the back of my head are not? Why is it that the moving of my hand to to adjust the brightness and contrast controls is a salient output event, while unnoticed perspiration is not?

One may be tempted to say that the psychologically salient inputs are those that contribute to the production of the uncomfortable glare sensation, and the psychologically salient outputs are those that manifest the concomitant intention to make an adjustment. But then the salient input/output events are being picked out by reference to mental events taken precisely NOT as causal role occupants, but as exhibiting intrinsic features that are neither causal nor neural: the glare quale has an intrinsic nature that cannot be resolved into relations to other items, and cannot be identified with any brain state. The functionalist would then be invoking the very thing he is at pains to deny, namely, mental events as having more than neural and causal features.

Clearly, one moves in a circle of embarrassingly short diameter if one says: (i) mental events are mental because of the mental causal roles they play; and (ii) mental causal roles are those whose occupants are mental events.

The failure of functionalism is particularly evident in the case of qualia.  Examples of qualia: felt pain, a twinge of nostalgia, the smell of burnt garlic, the taste of avocado.  Is it plausible to say that such qualia can be exhaustively factored into a neural component and a causal/functional component?  It is the exact opposite of plausible.  It is not as loony as the eliminativist denial of qualia, but it is close.  The intrinsic nature of qualitative mental states is essential to them. It is that intrinsic qualitative nature that dooms functionalism.

Therefore

4) It cannot be maintained with truth that AI systems are literally conscious in the way we are. Talk of computers knowing this or that is metaphorical.

Mind-Body Dualism in Aquinas and Descartes: How Do They Differ?

Thomas Aquinas, following Aristotle, views the soul as the form of the body. Anima forma corporis. Roughly, soul is to body as form is to matter. So to understand the soul-body relation, we must first understand the form-matter relation.  Henry Veatch points out that "Matter and form are not beings so much as they are principles of being." (Henry B. Veatch, "To Gustav Bergmann: A Humble Petition and Advice" in M. S. Gram and E. D. Klemke, eds. The Ontological Turn: Studies in the Philosophy of Gustav Bergmann , University of Iowa Press, 1974, pp. 65-85, p. 80)  'Principles' in this scholastic usage are not  propositions.  They are ontological factors (as I would put it) invoked in the analysis of primary substances, but they are not themselves primary substances. They cannot exist on their own.  Let me explain.

Spread Mind

Reader Matteo sends us here, where we read:

So let me tell you why the Spread Mind promises to solve one of the most difficult problems in the history of science and philosophy.

First, allow me to be clear about the terminology. First, all my efforts are based on a straightforward empirical hypothesis, the so called Mind-Object Identity hypothesis (MOI), namely the hypothesis that

The experience of X is one and the same as X

This should not come as a surprise to anybody. If our conscious experience is real, it must be something! And since the world is made only of physical stuff, there has to be something physical that is one and the same as our experience. I know, I know, many people have been looking for consciousness inside the brain. Have they succeeded? No. So let’s start looking for consciousness elsewhere. Where? In the very external objects around our body.

At this point I stopped reading. (Well, I did skim the rest, but it got no better.)

Yes, conscious experience is real. My present visual experiencing of a tree (or as of a tree to be precise) is undoubtedly real. And so the experiencing is, not just something, but something that exists. What the experiencing is of or about is, let us assume, also real.  Now we cannot just assume that "the world is made up only of physical stuff," but suppose that that is true. Still, the act and its object are two, not one: the experiencing and the tree experienced cannot be numerically identical even if both are physical. 

On the face of it, then, MOI is simply absurd.

This quickie response does not, of course, put paid to every theory of extended mind.

Am I being fair, Matteo?

What’s to Stop an AI System from having a Spiritual Soul?

John Doran in a comment presents an argument worth bringing to the top of the pile:

A) Anything conscious has a non-material basis for such consciousness.

B) Certain AI constructs [systems] are conscious.

Therefore:

C) Such AI constructs [systems] have a non-material component in which their consciousness resides.

Why doesn't that work? It's obviously valid.

In short, and in the philosophical colloquial, when a man and woman successfully combine their mobile and sessile gametes, a human person is brought into existence, complete with a soul.

So why can we not bring an ensouled being into existence as a result of the manipulation of silicon, plastic, metal, coding, and the application of electricity?

A provocative question.  But before he asked the question, he gave an argument. The argument is plainly valid. But all that means is that the conclusion follows from the premises. A valid argument is one such that if all the premises are true, then it cannot be the case that the conclusion is false. But are both premises true? I am strongly inclined to accept (A), but I reject (B).  The various arguments from the unity of consciousness we have been discussing convince me that no material system can be conscious. How does John know that (B) is true? Does he have an argument for (B)? Can he refute the arguments from the unity of consciousness?

Now to his question.

John appears to be suggesting an emergentist view according to which, at a certain high level of material complexity an "ensouled being" (his phrase) emerges or comes into existence from the material system.  His view, I take it, is that souls are emergent entities that can arise from very different types of material systems. In the wet and messy human biological system, a mobile gamete (a spermatazoon) mates with a sessile gamete, an ovum, to produce a conceptus such that at the moment of conception a spiritual soul comes into existence.  In a non-living silicon-based hunk of dry computer hardware running appropriately complex software, spiritual souls can also come into existence. Why not?

Emergence is either supernatural or natural.

Supernatural emergence is either Platonic or Christian. On the former, God causes pre-existent souls to take up residence in human bodies at the moment of biological conception.  On the latter, God creates human souls ex nihilo at the moment of conception.  Thus on the latter the coming to be of a human being is a joint task: the conjugal act of the parents supplies the material body and God supplies the spiritual soul.

Natural emergence involves no divine agency. Souls emerge by natural necessity at a certain level of material complexity, whether biological or computational. Edward Feser, in his discussion of William Hasker's emergent dualism, mentions a dilemma pointed out by  Brian Leftow.  (Immortal Souls, 2024, 517.) I'll put it in my own way. Souls either emerge from matter or they do not.  If they emerge, then they could only be material, which contradicts the assumption that they are necessarily immaterial.  If they do not emerge,  then they could be immaterial, but could not be emergent.  

The natural emergence from matter of an immaterial individual (substance) is metaphysically impossible.  The very notion is incoherent.  It follows that immortal souls cannot naturally emerge either biologically or computationally. The only way they could emerge is supernaturally.

There is a second consideration that casts doubt on naturally emergent dualism.  Does a spiritual soul, once it emerges, continue to exist on its own even after the material emergence base ceases to exist? In other words, are souls emergent entities that become ontologically independent after their emergence, or do they remain dependent upon the matrix, whether biological or silicon-based, from which they emerged? 

I'm inclined to say that 'naturally emergent dualism of individual substances' is a misbegotten notion.  Property emergence is a different story. I take no position on that. Leastways, not at the moment.