The Future of Attention
micro.mu·6h·
Discuss: Hacker News
Flag this post

Micro

18 Oct 2025

Be very careful, because if you look now, you might just get lost in the AI video slop of the future.

A few years ago a paper came out called Attention is all you need. We didn’t know at the time, but this would have a very profound effect on humanity, because the folk at OpenAI would take this and turn it into the predictive model that’s now known as the GPT series. Essentially training on a massive corpus of data, mostly internet data, they are able to predict the next token (characters or words) in a series that essentially then starts to look like human intelligence.

What you get back from text you put in is almost coherent if not clever responses that mimic humans …

Similar Posts

Loading similar posts...