The Human Skill That Eludes AI
In a certain, strange way, generative AI peaked with OpenAI’s GPT-2 seven years ago. Little known to anyone outside of tech circles, GPT-2 excelled at producing unexpected answers. It was creative. “You could be like, ‘Continue this story: The man decided to take a shower,’ and GPT-2 would be like, ‘And in the shower, he was eating his lemon and thinking about his wife,’” Katy Gero, a poet and computer scientist who has been experimenting with language models since 2017, told me. “The models won’t do that anymore.”