We sacrifice control in the name of convenience. As we become like cyborgs, we should expect more control over our technology. Tech has long aimed to provide additional conveniences for modern living, with the idea that a gadget would take care of something for us. The premise is that our lives are made easier when we worry less about the small stuff, stepping aside to allow technology do the grunt work. But the more we step aside, the less involved we are, and the less we control our environment, our information, our lives. We are giving algorithms control over increasingly complex aspects of our lives.
The idea of using an algorithm to care for humans has received popular attention recently with the case of a driver who died when his Tesla Model S drove underneath a semi that was crossing his lane. The car was in autopilot mode, with assistive radar and cameras activated; the driver died when the top of his car was sheared off by the underside of the semi trailer. Now begins the blame-aversion game that will become increasingly common as automation takes over automobiles: The car maker says autopilot is an assist feature and that the fault lies with the driver. Consumer Reports says the name “autopilot” suggests autonomy and that the fault lies with the software system. The driver — the one person directly affected by the incident — cannot share his take on things.