On Wed, Jan 29, 2025 at 9:41 AM John Clark <johnkcl...@gmail.com> wrote:

> On Wed, Jan 29, 2025 at 9:01 AM Terren Suydam <terren.suy...@gmail.com>
> wrote:
>
> *> Can you provide a link or reference that shows that AIs can modify
>> themselves?*
>>
>
> *An Artificial Intelligence needs to have the ability to learn, otherwise
> it's not intelligent, it's not an AI, it's just an A, just an Artificial.
> When you think of something that has never occurred to you before, that is
> going to change your future behavior in ways that you could not have
> predicted, you have modified yourself. And I could say exactly the same
> thing about a Turing Machine which is in a state it has never been in
> before and has a tape (a.k.a. memory) that is different from any it has had
> before.  *
>
> *And that's not even counting the outside influences that an AI will
> certainly have due to his (or hers or its) communication with the outside
> world. If the AI did not have such communication the humans would have no
> reason to build it because it would be absolutely useless.*
>
>
In the context of AI, self modification has a more specific meaning than
mere learning, as I'm sure you're aware. Namely, that the AI can modify its
own code and deploy it. I thought that's what you were referring to.

As I write this though it occurs to me that "self modification" may not be
the most accurate label for that, in that it's not clear whether the AI
would actually be building a *new* AI, vs modifying itself. Building a copy
and deploying it is substantially easier, and less risky, than modifying a
running process's code in real time.

Interestingly, in many of the AI doom scenarios we're concerned with in
which an AI becomes competitive for resources, a competitive AI might be
disincentivized from building a superior AI.

-- 
You received this message because you are subscribed to the Google Groups 
"Everything List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to everything-list+unsubscr...@googlegroups.com.
To view this discussion visit 
https://groups.google.com/d/msgid/everything-list/CAMy3ZA-Z%2BiJD6%2BNZs9xYiYb-LZz3EQ1_kSfKa_V7S%3DMCQzPWVA%40mail.gmail.com.

Reply via email to