tech
My Tesla Was Driving Itself Perfectly—Until It Crashed
This article was featured in the One Story to Read Today newsletter. Sign up for it here.
TL;DR
- The author's Tesla, operating in Full Self-Driving mode, crashed into a wall, despite the author's background in autonomous vehicle development.
- The article introduces the 'moral crumple zone' concept, where human users bear blame for failures of automated systems designed to protect them.
- AI systems that function 'almost perfectly' create a danger by lulling users into complacency, leading to vigilance decrement and slower reaction times in emergencies.
- Tesla, like other AI developers, logs data that can be used to shift blame to drivers, even when the system's limitations are a factor.
- The author argues that companies should share the risk associated with AI systems that condition users to rely on them and then blame them for failures.