It's Surprisingly Easy to Jailbreak LLM-Driven Robots: Researchers Trick Bots Into Dangerous Tasks - IEEE Spectrum

https://spectrum.ieee.org/jailbreak-llm

Researchers induced bots to ignore their safeguards without exception.

AI chatbots such as ChatGPT and other applications powered by large language models (LLMs) have exploded in popularity, leading a number of companies to explore LLM-driven robots. However, a new study now reveals an automated way to hack into such machines with 100 percent success. By circumventing safety guardrails, researchers could manipulate self-driving systems into colliding with pedestrians and robot dogs into hunting for harmful places to detonate bombs.

Solar storms made GPS tractors miss their mark at the worst time for farmers - The Verge

https://www.theverge.com/2024/5/12/24154779/solar-storms-farmer-gps-john-deer

Farmers had to stop planting their crops over the weekend as the strongest solar storms since 2003 battered the GPS satellites used by self-driving tractors

LandMark Implement, which owns John Deere dealerships in Kansas and Nebraska, warned farmers on Friday to turn off a feature that uses a fixed receiver to correct tractors’ paths. LandMark updated its post Saturday, saying it expects that when farmers tend crops later, “rows won’t be where the AutoPath lines think they are” and that it would be “difficult - if not impossible” for the self-driving tractor feature to work in fields planted while the GPS systems were hampered.

New Attack Against Self-Driving Car AI - Schneier on Security

https://www.schneier.com/blog/archives/2024/05/new-attack-against-self-driving-car-ai.html

This is another attack that convinces the AI to ignore road signs:

Robotaxi parks on woman’s leg after running her over

https://www.telegraph.co.uk/world-news/2023/10/03/san-francisco-cruise-driverless-car-woman-hit-and-run-crash/

The pedestrian was struck in a hit and run collision that threw her into the path of a driverless vehicle that then ran her over, stopping on top of her leg and remaining there until she was rescued by police, a witness told the San Francisco Chronicle.

The woman was admitted to hospital and is in a critical condition after the incident, which required the stationary car to be lifted off the ground, San Francisco’s fire department said.

Self-Driving Cars Are Surveillance Cameras on Wheels - Schneier on Security

https://www.schneier.com/blog/archives/2023/07/self-driving-cars-are-surveillance-cameras-on-wheels.html

Police are already using self-driving car footage as video evidence

Tesla’s ‘Self-Driving’ System Is Likely Involved in Fatal Crashes More Often Than Human Drivers – Pixel Envy

https://pxlnv.com/linklog/tesla-crash-safety-record/

Mercedes-Benz is the first to bring Level 3 automated driving to the US - The Verge

https://www.theverge.com/2023/1/27/23572942/mercedes-drive-pilot-level-3-approved-nevada

The company’s Drive Pilot system is approved for use in Nevada, but only at speeds up to 40 mph.

Level 3 systems are not without their risks. Most autonomous vehicle operators, including Waymo and Cruise, have said they think Level 3 is too dangerous, preferring to work exclusively on Level 4 technology. The reason is the need for drivers to stay attentive despite the vehicle performing most of the driving tasks.

There have been studies that show that hand-off between automated system and human driver can be especially fraught. When people have been disconnected from driving for a longer period of time, they may overreact when suddenly taking control in an emergency situation. They may overcorrect steering, brake too hard, or be unable to respond correctly because they hadn’t been paying attention.

Driverless Robotaxi Fleet Paralyzed for Hours in San Francisco

https://thelastdriverlicenseholder.com/2022/06/29/driverless-robotaxi-fleet-paralyzed-for-hours-in-san-francisco/

Apparently, the first system breakdown of a driverless robot taxi fleet occurred. In San Francisco, at least a dozen autonomous Chevrolet Bolts from GM Cruise Automation were spotted blocking the intersection at Gough Street and Fulton Street for a couple of hours

Driver must stand trial for deadly Tesla crash in California - AP News

https://apnews.com/article/technology-california-los-angeles-a8412a63a4e392e95a47da1b4a539a68

The driver of a Tesla operating on autopilot must stand trial for a crash that killed two people in a Los Angeles suburb, a judge ruled Thursday.

Toyota pauses Paralympics self-driving buses after one hits visually impaired athlete - Self-driving cars - The Guardian

https://www.theguardian.com/technology/2021/aug/28/toyota-pauses-paralympics-self-driving-buses-after-one-hits-visually-impaired-athlete

Japan’s Aramitsu Kitazono was left with cuts and bruises after being hit by the e-Palette vehicle at the athletes’ village

Tesla privately admits Elon Musk has been exaggerating about ‘full self-driving’ - The Verge

https://www.theverge.com/2021/5/7/22424592/tesla-elon-musk-autopilot-dmv-fsd-exaggeration

Tesla CEO Elon Musk has been overstating the capabilities of the company’s advanced driver assist system, the company’s director of Autopilot software told the California Department of Motor Vehicles.

Tesla is at Level 2 currently.

Tesla: “Full self-driving beta” isn’t designed for full self-driving - Ars Technica

https://arstechnica.com/cars/2021/03/tesla-full-self-driving-beta-isnt-designed-for-full-self-driving/

The transparency site PlainSite recently published a pair of letters Tesla wrote to the California Department of Motor Vehicles in late 2020. The letters cast doubt on Elon Musk’s optimistic timeline for the development of fully driverless technology.

For years, Elon Musk has been predicting that fully driverless technology is right around the corner. At an April 2019 event, Musk predicted that Teslas would be capable of fully driverless operation—known in industry jargon as “level 5″—by the end of 2020.

Tesla told state regulators that the software is “not capable of recognizing or responding” to “static objects and road debris, emergency vehicles, construction zones, large uncontrolled intersections with multiple incoming ways, occlusions, adverse weather, complicated or adversarial vehicles in the driving path, and unmapped roads.”

In a December follow-up, Tesla added that “we expect the functionality to remain largely unchanged in a future, full release to the customer fleet.” Tesla added that “we do not expect significant enhancements” that would “shift the responsibility for the entire dynamic driving task to the system.” The system “will continue to be an SAE Level 2, advanced driver-assistance feature.”

SAE level 2 is industry jargon for a driver-assistance systems that perform functions like lane-keeping and adaptive cruise control. By definition, level 2 systems require continual human oversight. Fully driverless systems—like the taxi service Waymo is operating in the Phoenix area—are considered level 4 systems.

Waymo One App Offers Driverless Alternative to Uber in Arizona - Bloomberg

https://www.bloomberg.com/news/articles/2020-10-08/waymo-one-app-offers-driverless-alternative-to-uber-in-arizona

The Google sister company is the first to offer a commercial ride-hailing service in cars with empty front seats.

Tesla Model 3 Drives Straight Into Overturned Truck In What Seems To Be Autopilot Failure

https://jalopnik.com/tesla-model-3-drives-straight-into-overturned-truck-in-1843827507

Tesla Autopilot Saved 8 Lives In Storm Dennis - CleanTechnica

https://cleantechnica.com/2020/02/17/tesla-autopilot-saved-8-lives-in-storm-dennis/

The Trump administration issues new guidelines for autonomous vehicles that rely on voluntary standards, despite calls for specific rules from safety advocates – Tom Krisher / Associated Press

https://apnews.com/d38d6dc3c126baed6d2da3f925dab884

Self-Driving Mercedes Will Be Programmed To Sacrifice Pedestrians To Save the Driver

https://www.fastcompany.com/3064539/self-driving-mercedes-will-be-programmed-to-sacrifice-pedestrians-to-save-the-driver

Instead of worrying about troublesome details like ethics, Mercedes will just program its cars to save the driver and the car’s occupants, in every situation.

Uber’s Self-Driving Car Didn’t Know Pedestrians Could Jaywalk - WIRED

https://www.wired.com/story/ubers-self-driving-car-didnt-know-pedestrians-could-jaywalk/

was not designed to detect pedestrians outside of a crosswalk

How Jaywalking Could Jam Up the Era of Self-Driving Cars - NYTimes

https://www.nytimes.com/2019/08/01/business/self-driving-cars-jaywalking.html

if pedestrians know they’ll never be run over, jaywalking could explode, grinding traffic to a halt.

the technical stuff will get worked out. It’s the societal part that’s the most challenging

Driverless electric truck starts deliveries on Swedish public road - Reuters

https://www.reuters.com/article/us-einride-autonomous-sweden/driverless-electric-truck-starts-deliveries-on-swedish-public-road-idUSKCN1SL0NC

The T-Pod is level 4 autonomous […], and uses a Nvidia Drive platform to process visual data in real time. An operator, sitting miles away, can supervise and control up to 10 vehicles at once.