Harald Schilly

← Thoughts

20 questions for a neural network

Draft, still being revised

Among the links on my old homepage there is “20Questions.net (neuronal network database)”. I was interested in neural networks 25 years ago. 20Q is a game: you think of something, the program asks up to twenty yes-or-no questions and then guesses. Robin Burgener started it in 1988 as an experiment. Since the mid-nineties it has run on the web and learns from the answers of the people who play. Back then it worked surprisingly well.

Nobody talked about large language models then. Neural networks were a niche, good for toys like 20Q or for recognising digits. The basic idea has stayed the same: a network of weights that learns from examples. What changed is the amount of data, the computing power and a few ideas in the architecture. Today such a network writes programs, proves theorems and also phrases this text.