On Monday, July 22, 2024, at 11:11 PM, Aaron Hosford wrote:
> Even a low-intelligence human will stop you and tell you they don't
> understand, or they don't know, or something -- barring interference from
> their ego, of course.
Yeah, why don't LLMs do this? If they are mimicking humans, they sh
On Sun, Jul 21, 2024, 10:04 PM John Rose wrote:
>
> You created the program in your mind so it has already at least partially
> run. Then you transmit it across the wire and we read it and run it
> partially in our minds. To know that the string is a program we must model
> it and it must have be
I directed the question at you because you are likely to understand how
different training and inference are since you said you "pay my bills by
training" -- so far from levelling a criticism at you I was hoping you had
some insight into the failure of the industry to use training benchmarks as
opp
The Large Text Benchmark and Hutter prize test language modeling
algorithms, not language models. An actual language model wouldn't be
trained on just 1 GB of Wikipedia from 2006. But what we learned from this
is that neural networks is the way to go, specifically transformers running
on GPUs.
On
That sounds like you're saying benchmarks for language modeling algorithms
aka training algorithms are uninteresting because we've learned all we need
to learn about them. Surely you don't mean to say that!
On Tue, Jul 23, 2024 at 5:42 PM Matt Mahoney
wrote:
> The Large Text Benchmark and Hutte
On Tue, Jul 23, 2024 at 7:07 PM James Bowery wrote:
>
> That sounds like you're saying benchmarks for language modeling algorithms
> aka training algorithms are uninteresting because we've learned all we need
> to learn about them. Surely you don't mean to say that!
I mean to say that testing
On Tue, Jul 23, 2024 at 7:15 PM Matt Mahoney
wrote:
> On Tue, Jul 23, 2024 at 7:07 PM James Bowery wrote:
> >
> > That sounds like you're saying benchmarks for language modeling
> algorithms aka training algorithms are uninteresting because we've learned
> all we need to learn about them. Surel
