Real signals or artificial stereotypes? (opens in new tab)

One thing I’ve learned building software tools over the years: people frequently use the default settings. Which means there’s a real risk that people are currently using AI to produce analysis that bears no resemblance to what people actually said. It’s an important reminder that when using LLMs to analyse human datasets, it’s worth checking you’re not getting familiar stereotypes in place of real signals.