I guess your objection to the idea of controlling AI is that free will is
an illusion and you really don't control anything. But free will is not
required. A thermostat controls the temperature, but without a good
definition we can debate whether a thermostat has free will.

The human brain runs a suboptimal algorithm to maximize reward. One
heuristic is to repeat actions that were rewarded in the past. This is
suboptimal in the case of drug addiction. The optimal decision would either
be to take a drug or not, regardless of any past usage, knowing what the
future effects will be. But that is not what we do.

The second heuristic is to experiment by not repeating the rewarded action,
which sometimes results in greater reward, even if the reward is just that
you learned something. The positive reinforcement of this choice
(regardless of outcome) is what gives us a sense of free will.

Reinforcement learning is always suboptimal because the optimal algorithm,
AIXI, is not computable.


On Thu, Jan 16, 2025, 2:08 PM twenkid <twen...@gmail.com> wrote:

> The Universe controls "you", whatever you are, but some of "us" are too
> much of "control freaks". Neither humans control the machines or AI, nor
> the reverse (and always some resolution, range, specifications are required
> for what does it mean to control), nor one agent controls the other, in the
> true meaning of "control". It could only do at a simplified virtual
> universe at a low resolution and with forgetting about the real processes,
> a sort of self-deception.
>

------------------------------------------
Artificial General Intelligence List: AGI
Permalink: 
https://agi.topicbox.com/groups/agi/Tff34429f975bba30-Md33401285607b5332ea0c0b4
Delivery options: https://agi.topicbox.com/groups/agi/subscription

Reply via email to