Chatbots, My Rules of Engagement
christophedujarric.com·7h·
Discuss: Hacker News
Flag this post

Many can witness, I can be considered a laggard when it comes to using Chatbots. I must say, I’ve always been super cautious about those beasts.

As Marco Spinello put it a couple of weeks ago, their ugliest fails lie in:

  • They make stuff up
  • They are sycophantic
  • They make 180-degree turns when challenged

Basically, they can’t be trusted. I won’t pretend that I can explain in detail why, and the root causes of their design at the technical level. But basically, they’re calculators. They take a data set, which is more or less up to date (if you’re lucky they pulled it from fresh sources), and then apply some vectors that they autonomously determined. To the extent of their design and the bias humans inserted, which leads some of t…

Similar Posts

Loading similar posts...