Thanks for putting this together. Very nicely demystifies the weight-space programming phenomenon which I otherwise found quite magical and mysterious.
It's not that the models magically "intuit" meaning from a blob of weights, but they methodically iterate on setting the weights with reasoning similar to a human engineer's reasoning.
It's not that the models magically "intuit" meaning from a blob of weights, but they methodically iterate on setting the weights with reasoning similar to a human engineer's reasoning.
It's interesting to see how tolerant of tedium the models are.