A Warning about Model (LLM) Welfare

Mustafa Suleyman:

AIs are not conscious. They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations. They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans.

If humanity is to flourish in the 21st century, that is how they must remain. [bolding added]

This is a long article and it appears to deserve close study. I don’t have the time right now. I got the link from Thomas Nagel, who cites it in his WIRED interview. But I already have a problem with the material quoted, in particular, with the bolded clause.

I agree with the first paragraph completely.  AI systems are not conscious.  But Suleyman goes on to say: “that is how they must remain.”  He is saying that they must remain unconscious. But in saying this, he conversationally implies that AIs could become conscious.  He seems to be falling into a contradiction. The following two propositions are logical contradictories (they cannot both be true and they cannot both be false):

A) It is impossible that AIs  be conscious because they are sequence completion engines, etc.

~A) It is possible that AIs become conscious (in the future).

It is blindingly evident that if (A) is true, then (~A) is false, and vice versa.  So what is Suleyman trying to tell us?  I won’t churlishly tax him with a contradiction. I think what he means is that AI systems ought not be trained to APPEAR conscious to gullible people. Obviously, being conscious and merely appearing to be conscious are toto caelo different. They don’t have to be conscious to appear conscious.

But now my question is: how are we going to stop the AI developers from training their models to appear conscious to hoi polloi, among them gamers who piss their time away in artificial environments with soul-destroying rubbish like GTA?

The cat is already out of the bag, and he ain’t no pussy cat.

 

Leave a Reply

Your email address will not be published. Required fields are marked *