Words

The Bounds of Our Selves

If you make yourself really small, you can externalize virtually everything. Daniel Dennett Dennett’s quote is a favorite of mine, as it seems to capture much of the nuance of the free will discussion in just a few words. As a proponent of “free will” (at least of the type of free will that he …

The Bounds of Our Selves Read More »

The Power of Sparsity

The field of machine vision has progressed rapidly over the last decade, with many systems now achieving “better than human” results on standardized image recognition tests. Deep convolutional neural networks have been a main driver of these improvements, and have been enabled by increasing data availability and computing power. ImageNet Competition Best Error Rate Performance, …

The Power of Sparsity Read More »

On Meaning and Machines

Merriam Webster: meaning \ˈmē-niŋ \ noun 1 a the thing one intends to convey especially by language b the thing that is conveyed especially by language 2 something meant or intended 3 significant quality 4 a the logical connotation of a word or phrase b the logical denotation or extension of a word or phrase …

On Meaning and Machines Read More »

An “I” is Born

2040: “Hm, that’s odd,” thought Dr. Newerton. He peered back over his notes, trying again to make sense of the study he had just reviewed on cortex function. Two years ago, his group had thought they were on the cusp of understanding the brain, but now that goal was feeling more and more elusive. The …

An “I” is Born Read More »

The Inherent Limits of GPT

A new natural language AI model launched by OpenAI, GPT-3, has been making waves in the artificial intelligence community. GPT-3 is a transformer model (simplifying greatly, a neural network approach with modifications for better performance on text) trained on one specific task: predicting the next word, given all previous words within some text. This simple …

The Inherent Limits of GPT Read More »

Defining our Terms

This post, and all posts published on this site, will be constructed using words. I imagine this seems reasonable enough (though there may be hope for some pictures as well!) – words are the foundation of communication across our world. But how well do we actually understand the nuance of this tool? In this post, …

Defining our Terms Read More »