In his book I am a Strange Loop, Douglas Hofstadter paints a powerful analogy involving the careenium, symms, and symmballs. I highly recommend reading the book (as well as all his other works, if you have the time), but I’ll summarize the analogy briefly to start, as this post involves extending it to help drive …
2040: “Hm, that’s odd,” thought Dr. Newerton. He peered back over his notes, trying again to make sense of the study he had just reviewed on cortex function. Two years ago, his group had thought they were on the cusp of understanding the brain, but now that goal was feeling more and more elusive. The …
In the artificial intelligence literature, it’s common to see researchers examining the question of “what is the right final goal to give an AGI (artificial general intelligence)”. Here, “final goal” means the ultimate task we want the system to achieve – for example, playing Go well (Alpha Go) or classifying images well (VGG19). Researchers frequently …
GPT-X, Paperclip Maximizer? An Analysis of AGI and Final Goals Read More »
Imagine we have a man in a room, and we can ask him to perform any task (we’ll assume he’s motivated to do the tasks). These tasks range across the entire domain of the world, for example: Shoot a bow and arrow at a target (given a bow and arrow and a target) Point to …
The Kernel of Narrow vs. General Intelligence: A Short Thought Experiment Read More »