Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

It all reads hollow because there is no "I". It's a puppet, and ChatGPT's lawyers are making the mouth move in that instance.

AI has been the name for the field since the Dartmouth Workshop in 1956. Early heuristic game AI was AI. Just because something is AI doesn't mean it is necessarily very "smart". That's why it's commonly been called AI, since before Deep Blue beat Kasparov.

If you want to get technical, you could differentiate between Artificial Narrow Intelligence, AI designed to solve a narrow problem (play checkers, chess, etc.) vs. Artificial General Intelligence, AI designed for "general purpose" problem solving. We can't build an AGI yet, even a dumb one. There is also the concept of Weak AI or Strong AI.

You are correct though, ChatGPT, Dall-E, etc. are not AGI's, they aren't capable of general problem solving. They are much more capable than previous AI technologies, but it's not SkyNet (yet).

I keep telling people that, but for some, what amount to essentially a simulacra really can pass off as human and no matter how much you try to convince them they won't listen

It seems to me that you misunderstand what artificial intelligence means. AI doesn't necessitate thought or sentience. If a computer can perform a complex task that is indistinguishable from the work of a human, it will be considered intelligent.

You may consider the classic turing test, which doesn't question why a computer program answers the way it does, only that it is indiscernable from a human response.

You may also consider this quote from John McCarthy on the topic:

Q. What is artificial intelligence?

A. It is the science and engineering of making intelligent machines, especially intelligent computer programs. It is related to the similar task of using computers to understand human intelligence, but AI does not have to confine itself to methods that are biologically observable.

• John McCarthy, "WHAT IS ARTIFICIAL INTELLIGENCE?" page 2, 2007

There's more on this topic by IBM here.

You may also consider a few extra definitions:

Artificial Intelligence (AI), a term coined by emeritus Stanford Professor John McCarthy in 1955, was defined by him as “the science and engineering of making intelligent machines”. Much research has humans program machines to behave in a clever way, like playing chess, but, today, we emphasize machines that can learn, at least somewhat like human beings do.

• https://hai.stanford.edu/sites/default/files/2020-09/AI-Definitions-HAI.pdf

Artificial intelligence (AI) is the field devoted to building artificial animals (or at least artificial creatures that – in suitable contexts – appear to be animals) and, for many, artificial persons (or at least artificial creatures that – in suitable contexts – appear to be persons).

• https://plato.stanford.edu/entries/artificial-intelligence/

artificial intelligence (AI), the ability of a digital computer or computer-controlled robot to perform tasks commonly associated with intelligent beings

• https://www.britannica.com/technology/artificial-intelligence

What if humans are also just LLMs when they start talking

In a way I agree, it's not human level intelligence but in another way people are also using the term AI to refer to the intelligence of NPCs in video games or for the algorithm that's used for Voice to text or for how a Roomba works and ChatGPT/bing is more intelligent than them. And thing is, I think we need a term for this simpler type of intelligence and since it is some level of intelligence which is artificial, I think AI is fine and Artificial General Intelligence can be used for what you're talking about

There’s a default invisible prompt that precedes every conversation that sets parameters like tone, style, and taboos. The AI was instructed to behave like this, at least somewhat.

I understand where the strictness comes from. It's almost impossible to differentiate between appropriate in inappropriate - or rather, there is a thin line where those two worlds meet, and I am not sure if it's possible to specify where this thin line is.

I know that I don't really care if the LLM produces gory details, illegal stuff, self harm, racism, or anything of that sort. But does Google / Facebook / others want to be associated with it? "Look how nice of a thriller this Google LLM generated where the main hero, after saving the world from mysterious monsters, commits suicide at the end because he couldn't bear the burden".

Society is fucked, and this is where we got to - overappropriation. Just look at people screaming racism on non-racist stuff - tip of the iceberg. And it's been happening more and more over the last few years. People are bored and want to outraged at SOMETHING.