Today Thinking Machines Lab is launching our research blog, Connectionism. Our first blog post is “Defeating Nondeterminism in LLM Inference”
We believe that science is better when shared. Connectionism will cover topics as varied as our research is: from kernel numerics to prompt engineering. Here we share what we are working on and connect with the research community frequently and openly.
The name Connectionism is a throwback to an earlier era of AI; it was the name of the subfield in the 1980s that studied neural networks and their similarity to biological brains.
The name Connectionism is a throwback to an earlier era of AI; it was the name of the subfield in the 1980s that studied neural networks and their similarity to biological brains.
Hah! Even before reading this, I had to think of Heinz von Foerster's talk "2 x 2 = grün" (2 x 2 = green) in which he describes deterministic vs. non-deterministic automata.
His work in second-order cybernetics and later, "the area of self-organizing systems, bionics, and bio-inspired computing; that is, analyzing, formalizing, and implementing biological processes using computers" at BCL feel primordial-soupy to Connectivism.
en.m.wikipedia.orgHeinz von Foerster - Wikipedia↗ en.m.wikipedia.org