Overconfidence and AI | Seth's Blog
seths.blog/2023/01/overconfidence-and-ai
What Jamie wrote
Godin hits on a topic that I've been wondering about — why do people put so much trust, often unearned, in some forms of technology? OpenAI and ChatGPT are phenomenal, but it is brand new tech and it gets a lot wrong. On the extreme, there are people that die every year because they let their Tesla do the driving. I drive a Tesla, and I can tell you I wouldn't trust it to do anything beyond the most basic highway driving.
I believe that it is something about the medium. We are used to computers operating with perfect accuracy. No computer gets a math problem wrong. So when the math gets really probabilistic, and a guess is made, it is in the same space that we are used to getting uncompromisingly correct results.
So we trust it.
Even when we shouldn't.