When you design your fully autonomous systems it is important to have a good plan for how the system will fallback to human control when needed. See what happened to this driverless Waymo.
Photo from Wikimedia
Thoughts on how to improve patient safety through the implementation of Human Factors