On Tue, Oct 22, 2024, 11:16 AM stefan.reich.maker.of.eye via AGI < agi@agi.topicbox.com> wrote:
> On Monday, October 21, 2024, at 10:38 PM, dissipate wrote: > > just develop AI that is better than humans at a very specific task: > researching and developing AI itself > > Just make a program that solves the hardest problem of all - presto, you > solved the hardest problem of all. > Well, no. Intelligence depends on knowledge and computing power, or ultimately just computing power because you need it to acquire knowledge. Unless you can define and enforce a fitness function or a test for intelligence, then it defaults to acquiring computing power by any means possible. That means competing with humans for atoms and energy. This is the 20 year old unfriendly AI problem. You can't test for superhuman intelligence because you aren't smart enough to know if it is giving the right answers. You can't control what you can't predict. You can't specify a fitness function, and you couldn't enforce it even if you could. The best we have come up with is the Turing curse (test), where the highest possible score is human level. We can't even test people for an IQ of 200. Your phone can do arithmetic a billion times faster than you and has a billion times more short term memory. What would you say its IQ is? So stop throwing around meaningless terms like AGI or ASI. Say what you really mean. We want technology that gives us everything we want without having to pay or work for it. That we can do. We acquire all human knowledge (10^19 characters compressed to 10^17 bits) and the equivalent computing power of 8 billion brains: 10^26 operations per second over 10^25 parameters. It's just a $1 quadrillion engineering problem. I'm happy to see that Ben is finally getting the resources for some real AI research. I'm looking forward to a Large Text Compression Benchmark submission with no limits on computing power. ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T3ced54aaba4f0969-M107b19824402d17da67a27e3 Delivery options: https://agi.topicbox.com/groups/agi/subscription
