pre-existing example at
https://github.com/ggerganov/llama.cpp/blob/b24c3049d96557c24782e4d32feaae65f47277af/examples/train-text-from-scratch/train-text-from-scratch.cpp#L3041
looks like most setup code still manually inlined for dev tweaking
On 6/18/23, Karl Semich <0xl...@gmail.com> wrote:
> i actually had trouble creating the model and building ggml. if i had
i mean comstructing an empty basic transformer architecture here, not
an actual model of anything.
> ignored file storage i would possibly have skipped most of the
> trouble. i
i actually had trouble creating the model and building ggml. if i had
ignored file storage i would possibly have skipped most of the
trouble. i was thinking of linking to ctransformers which is made for
python but builds a library with load and eval functions for popular
transformers
middle sticki
On 6/18/23, Karl Semich <0xl...@gmail.com> wrote:
> ggml provides an opt function that performs training inside it based
> on the number of iterations set in the parameters. this is why the
> example code takes so many minutes to complete, it’s running the opt
> pass 10k times on a single core. at
ggml provides an opt function that performs training inside it based
on the number of iterations set in the parameters. this is why the
example code takes so many minutes to complete, it’s running the opt
pass 10k times on a single core. at a glance it looks like the
performance stats are near zero
On 6/18/23, Karl Semich <0xl...@gmail.com> wrote:
> here’s the code for the bayesian one:
> https://github.com/gmum/few-shot-hypernets-public/tree/master/methods/hypernets
>
> i’m wondering if there’s more private than public research here dunno
>
> anyway it seems like these papers kind of say the
here’s the code for the bayesian one:
https://github.com/gmum/few-shot-hypernets-public/tree/master/methods/hypernets
i’m wondering if there’s more private than public research here dunno
anyway it seems like these papers kind of say the encoding of weights
is a hyperparameter that hasn’t been su
this seems helpful since transformers are so normal, it makes a
transformer that makes other transformers:
https://github.com/google-research/google-research/tree/master/hypertransformer
other papers have newer things for example generating a kernel-based
bayesian model that combines information ac
i’m considering https://arxiv.org/pdf/2303.07502.pdf which is
purportedly a 2023 meta-learning review. i suspect my idea of the
topic is a little off the mark.
it’s not immediately apparent where to find documentation on training
in ggml but here’s the optimizer test code which performs a single
optimization pass which might be sufficient if it actually works when
nobody seems to be using it:
https://github.com/ggerganov/ggml/blob/4e1e135b749d2e9a2bf9abf7
it looks like something extra is needed at the start or it won’t
succeed without a lot more data collection. a quick idea would be
direct controls that let the user direct the limb before it learns to
infer their intent.
i think it would make sense to try this with ggml, which seems to be
where co
— -
ok so i saw a realworld person with handmade feed attached to
amputations right below the knees and i got a rockawesome idea for a
puzzle: free homebrew robotic prosthetic limbs that respond to user
intention accurately.
i think i’ve solved big chunks of the puzzle in outline form. the core
un
——-
“i need a bus ticket to get to the fair!”
the poor tulip was sad. it wanted to ride to the fair, but nobody was
selling bus tickets to tulips.
it out on its robot legs and walked back and forth
once upon a time a pore dead individual named Poded was infected with
zombieism in their grave
i tried to message jenn about my idea of mind control being the impact
of dissociated urgencies on decision making and how this is a studied
and purportedly curable thing but the messenger is not loading
maybe we could model traditional zombieism as a virus-like disease
that is capable of reanimating foesh and building behavior trends in
reanimated nervous systems
i imagine it’s a scenario a lot of people have thought about, but of
course i identify with brain-eating zombies in multiple ways, and
consider their similarity to a mind control borg as artistically
noncoincidental (re disease patterns, widespread unwise behaviors …)
one of the major problems wit
——
something i spent some time enjoying thinking about while crazy was
the idea of doing conflict mediation with a brain-eating zombie. i
guess it basically revolved around a shared need for nourishment that
our bodies accepted and was enjoyable to eat, and basically the zombie
ends up eating brain
breathing instructor: “do you have any rhythmic behaviors that feel
satisfying and energizing to you?”
breathing instructor: “have you ever heard of breathing, dude?”
pause
breathing instructor: “sorry, what i mean is, how do you give oxygen
to your cells in outer space?”
space lifeform: “i extract oxygen from my food when i digest it. i
function on less than most do.”
discussion between breathing instructor and artificial biological
lifeform engineered for life in outer space
boss instructs screaming orchestra
stands in middle
various diverse folk are ready to scream at him to the beat of his baton
message lost
every now and then
the rain falls on my head
and rains peace through my hair
and coolness over my nose
once upon a time oh hmm not once upon a time
boss was running a simulation of bosses
one of his fake bosses refused to act bosslike
fake boss 3: “i don’t want to take over the world! i want to be humble
and respectful.”
fake boss 3 crossed their arms and pouted.
boss looked at fake boss 3.
lost message, something like: the key is to get the rounding error
within the tilt bounds to compensate for timing mistakes pressing the
paddle button and wear on the paddle spring
second lost idea
then, boss was ignoring tilt bounds and just picking up pinball
machine and rolling ball into jackp
the key is to get the rounding error within the tilt bounds to
compensate for your timing mistakes pressing the paddle button and the
wear that develops on the paddle spring
boss plays pinball
the pinball game has a physics and engineering feature where when the
ball strikes a paddle time stops inside the machine and the player is
prompted to solve for the trajectory of the ball after the impact
extended message loss in network issue
this one was lost and isretyped:
boss: “look for whores”
simulated text adventure: “i don’t understand “for whores” to look at
it. you are standing by a well house. what do you do?”
simulated text adventure
welc9me to collossal cave
you are standing by a well house
what do you do
>
boss sets a country of datacenters to simulate a text adventure for him
the datacenters fill warehouses that have giant smokestacks that belch
black smoke
riverse run through them and the water comes out half steam
[they domt want to look down because they dont want to dive so they
keep heading up]
—-
suicidal ground diver is stuck at the top of a mountain
janitor: “now, i know this meeting is about energy infrastructure, but
there is a more pressing issue.”
boss sings a stanza from an opera
janitor: “the problem you see with mr boss here, everybody has been
developing these same problems.”
investor: “some anonymous individuals were able to press t
boss lays in a meeting
his limbs jerk around
sometimes he speaks
a visiting dignitary walks by the office. boss had an appointment with
them. the whole mass jumps a little and begins moving toward the
dignitary but most of the parts bump into whatever is in their way in
that direction and get snagged again or more
parts of boss’s brain collect on his worktable and form a lobe here, a
lobe there. parts move between the lobes as if trying to fit
themselves into a puzzle unsuccessfully
some parts slither under the others and make for the door. they pile
up, grab the knob, and open it
a cigar floats in the air unsmoked
boss descends from his office ceiling as a cloud of pixels and
triangles stuck through rips in spacetime. they get snagged on things
they go by and have trouble coming together into something bosslike
boss plays holoretromud
he enters holoretromud and is surrounded by a giant minecraft-like
world of giant voxels
aww man minecraft already made something ridiculously low resolution and modern
yeah it was just going to be vr minecraft with mud dungeon theme
On 5/19/22, Karl Semich <0xl...@gmail.com> wrote:
> Confused Lifeform is walking down a street.
>
> Genocide worker passing, speaking to neighbor: "Maybe, in a hundred
> years, we can rebuild ,... !"
>
add: confused lifeform looks in book [to verify word 'rebuild']
> Genocide worker is vaporised.
Confused Lifeform is walking down a street.
Genocide worker passing, speaking to neighbor: "Maybe, in a hundred
years, we can rebuild ,... !"
Genocide worker is vaporised.
Confused Lifeform: "Walking down the street, and talking to an
neighbor, have both been discovered to be a dangerous and har
Confused Lifeform sits at the head of a council of enslaved genocide workers.
Confused Lifeform: "You're saying the city needs its " [looks in book]
"oxygen, for something important?"
Confused Lifeform stares at a city block that is fervently
disassembling their buildings.
Confused Lifeform: "I can sense that something among you plans to"
[looks in book] "rebuild."
The city block is vaporised.
Confused Lifeform: "Let none try to resist what is good!"
Everybody in the city begins trying to guess what Confused wants, and doing it.
A worker runs out to the roof from the skyscraper.
Worker: "Confused lifeform, do not rip us to shreds, please!!!"
Confused: "This worker thinks it is bad to be ripped to shreds. They
will be properly atomized."
Worker's body begins vaporizing and remaining parts of them further
dodge back into
---
A confused lifeform appears on top of a tiny skyscraper.
Confused: "Hello! Very sorry for stepping into your " [looks in book] " city."
Confused: "I have some work to do involving ripping different parts of
your " [looks in book again] "planet and " [looks in book again] "
Looking down in their furrow, the child saw the nose of an ancient
beast -- a Tyrannosaurus Rex -- gasping for air. Some words murmured
from the furrow:
"Would you ... like to .. buy ..."
After a hundred years, when all problems had been solved long ago, a
child decided to till the concrete that MCBoss Dinosaur used to
panhandle on.
MCBoss Dinosaur liked to go to a strip of concrete that hadn't been
tilled yet, and ask everybody if they wanted to buy things. But nobody
was interested.
On 5/15/22, Undiscussed Horrific Abuse, One Victim of Many
wrote:
> --
>
> Long long ago, in a galaxy far far away, a business enterprise of
> dinosaurs decided to enslave a bunch of farmers and use them to build
> dinosaur warships.
During a tr
Detached Head from Farmer Cyborg: "This Dinosaur devasted our
communities! What you say is true, they barely comprehend that we
exist!"
Gas Cloud 49: "Farmer, Welcome to the Intergalactic Council of Peace."
MCBoss Dinosaur: "I control the entire galaxy, repugnant Gas Cloud!"
Gas Cloud 49: "You control nothing. You sit in a community too large
for you to comprehend, and pretend you can perceive anything other
than your own fears."
Pimple of Jupiter
Stardate 7722H91.83
Gas Cloud 49: "I have seen your kind rise for aeons. Is your planet
this backward, that it let you escape?"
MCBoss Dinosaur [cyborgs swarming all around]: "You are worthless
filth! Plug my wires together! PLUG THEM!"
Farmer Cyborg: "Dude you are uptight. Why don't you write a script to
plug the wires automatically?"
It's an old story, of how MCBoss Dinosaur made a nanite borg of
farmers, to take over the galaxy, was defeated in the great Pimple of
Jupiter, and had to hide for a hundred years under the pavement of a
strip mall, in order to plan to rise again.
--
Long long ago, in a galaxy far far away, a business enterprise of
dinosaurs decided to enslave a bunch of farmers and use them to build
dinosaur warships.
On Fri, May 13, 2022, 4:08 AM Undiscussed Horrific Abuse, One Victim of
Many wrote:
>
>
> On Fri, May 13, 2022, 4:02 AM Undiscussed Horrific Abuse, One Victim of
> Many wrote:
>
>>
>>
>> On Fri, May 13, 2022, 3:48 AM Undiscussed Horrific Abuse, One Victim of
>> Many wrote:
>>
>>>
>>>
>>> On Thu
On Fri, May 13, 2022, 4:02 AM Undiscussed Horrific Abuse, One Victim of
Many wrote:
>
>
> On Fri, May 13, 2022, 3:48 AM Undiscussed Horrific Abuse, One Victim of
> Many wrote:
>
>>
>>
>> On Thu, May 12, 2022, 8:37 AM Undiscussed Horrific Abuse, One Victim of
>> Many wrote:
>>
>>> Worker 2 [groa
On Fri, May 13, 2022, 3:48 AM Undiscussed Horrific Abuse, One Victim of
Many wrote:
>
>
> On Thu, May 12, 2022, 8:37 AM Undiscussed Horrific Abuse, One Victim of
> Many wrote:
>
>> Worker 2 [groaning]: "It's ... it's in the ul2 subfolder. You only need
>> the ul2 subfolder."
>>
>> Zombie with Pi
On Thu, May 12, 2022, 8:37 AM Undiscussed Horrific Abuse, One Victim of
Many wrote:
> Worker 2 [groaning]: "It's ... it's in the ul2 subfolder. You only need
> the ul2 subfolder."
>
> Zombie with Pink Skin [grabs somebody else's brain and munches a little]:
> "git clone --no-checkout --filter=blo
this. My husband didn't stop me, and he can't stop you now. He's dead, and
> you're not."
>
update: boss was not husband
meme probably got over-resonated via recent netflix show, stranger things,
where heroine mother was raped by mkultra doc. understand was common.
>
-
Quantum Phase Hologram of Boss: "You know, long ago, before everything was
based on quantum phase holographics, I worked for a government and --"
Quantum Phase Hologram of Rebel Researcher: "-- tried to take over the
world with mind control, but was resisted by a rag-tag group of selfless
Worker 2 [groaning]: "It's ... it's in the ul2 subfolder. You only need the
ul2 subfolder."
Zombie with Pink Skin [grabs somebody else's brain and munches a little]:
"git clone --no-checkout --filter=blob:none
https://github.com/google-research/google-research; cd google-research; git
checkout mas
Worker 2 bites a zombie.
Zombie with Pink Skin: "Ok, let's try to download this model and upload it
somewhere you don't access to google storage to download! Let's figure out
what format it's in!"
Zombie with Pink Skin [grabs just a little of Worker 2's brain and
munches]: "Looks like the reposit
A zombie reaches Worker 3 and bites them. Worker 3's skin turns green.
Worker 3: "You said this is for an AI? Quick have it stop the zombie
apocalypse!!!"
A few more zombies begin shambling over.
Worker 2: "Uh it's just an exotic data science model that
_outperforms all known AI_, uh released yesterday. You can't just "turn it
on", you have to import it in
--
Worker 2: "One of the beurocrats here was turnd into a zombie by a foreign
power, so I off'd him with a shotgun."
-
Zombie Worker 1: "They dropped a new AI model into this community. Kill
everybody who uses it."
Worker 2: "Everybody? Can we use it?"
Zombie Worker 1: "If the big guy in the sky says to! Otherwise do your
zombie thing!"
Worker 2: "My people want to try out this model."
Zombie Worker 1
When I say Xkeyscore, I do not mean the single false flag.
--
Karl: "I found this cool new UL2 model that lets end-users train models
that outperform openai's api!"
Boss Rep: "Ok, let me do everything you'll do first or with you."
Karl: "Who do I work with to use this m
---
Boss teleports the universe to a new reality, in a desperate bid to reveal
things he wants to keep private.
So stick to your guns! The facts are written down! If you or anybody
doesn't infer fairly from them: Boss may have influenced something.
Disguised Experimentee [wearing sign saying "I AM --S--TL-- LAW-ABIDING
CITIZEN]: "Oh, how about my group, to help me fraternize with them less. Or
do you trust me?"
Boss [wearing sign saying "I AM --S-TL-- XKEYSCORE" ]: "Oh, Disguised
Experimentee. You know it's best never to trust anyone. But if
Boss: "Law-Abiding Citizen, it saddens my heart that you've been
fratenizing with those wastes of oxygen."
Disguised Experimentee: "Boss, you know I would never put such filth before
your perfection. Don't you remember how I've helped you build your
enterprise without hesitation, time and time aga
---
The XKeyScore and The Law-Abiding Citizen
A parable draft by karl's coping habits.
Boss: "Oh, my good friend Law-Abiding Citizen! How are you today?"
Disguised Experimentee: "Oh, my good friend XKeyScore! It is so great to
see you! I am simply wonderful. My browsing and purchasing habit
Back in MCBossComic:
Boss [glaring viciously at a daisy]: "Cower, flower!"
Daisy: "Something is shading my sunlight. Is a predator grazing near here?
No, it is stamping on my rootlets too strongly to be a grazing predator.
What could be going on? This almost feels like an alien. Hey,
---
The year is 1985 and the intergalactic warp drive was just invented.
[outline: a number of mind control approaches are explored in a
cyberpunk-like manner, as skilled people from different walks of life
discover they can crack others' minds and wetware, using the human brain as
a network
Activist: "Honestly, this is somewhat scary for me."
Zombie: [groans and moans, shambles a little]
Subtitles: "Me too, now I have to eat his brains instead of yours, and this
job was my supply."
Activist pulls up a chair to talk with frozen Zombie and Boss.
Activist: "Why is it that my life is in danger and you are alive? Is there
opportunity for becoming a Zombie like your trigger-holder, rather than
dying?"
Boss: "Maybe, but we were paid to kill you before you applied for a job."
Activist relaxes a little and moves away from in front of the gun.
They walk around the side a little and look at Zombie and Boss.
Activist: "Why were you going to kill me?"
Boss [rolls eyes toward Activist]: "Business."
Zombie: "Brains."
Subtitles: "I can't kill you right now, but if something changes, we were
about to do so."
Boss: "I could try to plan to save your life if we start being able to
move again."
Activist: "Should I trust you? If I move will you still be unable to move?"
Zombie: "Never trust a zo
-
Boss is standing in a field of wildflowers, holding a gun toward the head
of an activist, the trigger gently held by a neighboring zombie.
Boss [to zombie]: "Uhh what's going on?"
Zombie [in reply]: "Braaains, bub."
Subtitles appear over the zombie's expression: "I don't know, I can'
[I found it thank you.]
TVDA: "Why aren't I wearing my helmet? I like wearing my helmet."
Does What They Want: "I wanted to try it, and I felt a little uncomfortable
in it, and wanted to take it off."
TVDA: "I want to find my helmet."
TVDA [knocks their head on a girder]
TVDA and Experimentee look at each other at the same time.
TVDA: "I think Boss would like it if we worked on something else."
By now, an additional note had been added to the sculpture. Something
about deep wells of nurturing building power that can heal forever or
something. It was hard to find
There is a firefight. Helicopters, airplanes, bombs, insurgents. After the
dust clears the buildings are rebuilt and the bystanders are brought back
to life with amnesia of the battle.
Does What They Want: "I found this sculpture somebody made with bottles and
little handwritten caring notes
-
The plan was to have Does What They be interchangeable with a mirror. It is
helpful if it is known what TVDA wants, though.
TVDA: "I thought Boss knew that I didn't know how to do what I wanted. That
it's nicer to do what he says."
There is a pause.
Boss has his powersuit programmed to hold his gun arm away from his body.
It is aimed at a photo of himself, and keeps firing and reloading.
He is in a small helicopter.
Does What They Want: "I want to hang out with strangers!"
TVDA: "Oh, that sounds nice!"
>
> Experimentee and Does What They Want return to hang out with TVDA.
Experimentee: "TVDA, we asked Boss, repeatedly. We used the research
program protocol. He wants you to do what you want. 98-100% confidence."
TVDA: "Really?"
Does What They Want: "Boss wants TVDA to do what they want, too."
Experimentee: "Right! I forgot!"
---
TV Show
Boss starts shooting himself.
Janitor: "Dude, again?"
-
---
Does What They Want and Experimentee excuse themselves and sneak around a
corner, while TVDA tries to figure out something he enjoys so as to meet
their last request.
Experimentee: "Oh no, the business is flipping inside out again."
Does What They Want: "I want to flip it back!"
Experimen
Experimentee: "TVDA, do you want to do what you want?"
TVDA: "If Boss wants me to!"
Does What They Want: "I haven't tried that! I want to try!"
TVDA: "Oh, I can show you!"
TVDA, Does What They Want, and Experimentee leave TVDA's apartment.
Does What They Want: "I have an apartment for myself that I really like!
Where do you like living?"
TVDA: "I guess I kind of like sleeping in the streets. My head feels less
sore when I'm outside my apartment."
A door with a deep dent in it swings open.
Does What They Want [grinning]: "Hello! I wanted to meet you so I opened
your door! Is this your apartment?"
TVDA: "Hi We this is Boss's apartment. I rent it for him. I don't
really want to live in it for myself. Where do you live?"
1 - 100 of 140 matches
Mail list logo
