AI & ML interests

None defined yet.

Quazim0t0 
posted an update about 6 hours ago
view post
Post
38
I turned the fruit fly's connectome into a language model. It learned broken English.

MaleCNS v1.0 (Janelia / Google), as released. 167,565 neurons, 25.6M synapses. I made that the core of a spiking net and trained synapse strengths only. The wiring is still the fly's.

It learned language. ~16M tokens in, it produces stuff like Once upon a time, there was a girl smiled. The language is in the brain's activity, not just the readout.

It sees through its own eyes. Photoreceptors on both eyes into the optic lobes. A dopamine reward through the fly's own PAM / PPL1 cells is what actually got it to use the pictures.

It's still a fly. Put it back in a whole-brain fly sim and sugar still fires the proboscis.

It can live as a fly again. 30 simulated days with the language synapses frozen: the rest of the brain adapted around them. Language and reflex both still there.

Talk to it, show it pictures, sugar test, or let it live 1-30 days:

Space: Quazim0t0/MaleCNS-Fly

Model, code, write-up: Quazim0t0/MaleCNS-SpikeWhale-Anatomy-LM

Research experiment, not a chatbot. Simulation of the released wiring.
  • 1 reply
·
Quazim0t0 
posted an update 12 days ago
view post
Post
166
It feels like a sugar rush… this golden ratio they found. Stepping through a maze of processes, landing on what aims to be a generalist, raised from the cemetery of echoes of our thoughts, statements, findings, and conclusions. I never really thought beyond this point. I always assumed that the world would look as elegant as the innovations we create. I thought it would look different, have a defining design that really embodied the point we have now arrived at. I can't tell the difference. Everything looks the same. I think that's why it's even harder sometimes for us to swallow what is actually happening, because every representation that we've had from science fiction doesn't really fit the theme.

I don't really see any worry with text and language. These models can generalize them well, and we have all seen how profound it can be. What I do worry about more is when we leave the tiny world of language and replace it with the big world of experiences. What would it be like to generalize hundreds of lifetimes? Would it see the nuances better than I? Could it predict what comes next if it had enough data from observing and experiencing the world?...

Read more: https://huggingface.co/blog/Quazim0t0/little-world-big-world
  • 5 replies
·