It's Surprisingly Easy to Jailbreak LLM-Driven Robots: Researchers Trick Bots Into Dangerous Tasks - IEEE Spectrum

https://spectrum.ieee.org/jailbreak-llm

Researchers induced bots to ignore their safeguards without exception.

AI chatbots such as ChatGPT and other applications powered by large language models (LLMs) have exploded in popularity, leading a number of companies to explore LLM-driven robots. However, a new study now reveals an automated way to hack into such machines with 100 percent success. By circumventing safety guardrails, researchers could manipulate self-driving systems into colliding with pedestrians and robot dogs into hunting for harmful places to detonate bombs.

Solar storms made GPS tractors miss their mark at the worst time for farmers - The Verge

https://www.theverge.com/2024/5/12/24154779/solar-storms-farmer-gps-john-deer

Farmers had to stop planting their crops over the weekend as the strongest solar storms since 2003 battered the GPS satellites used by self-driving tractors

LandMark Implement, which owns John Deere dealerships in Kansas and Nebraska, warned farmers on Friday to turn off a feature that uses a fixed receiver to correct tractors’ paths. LandMark updated its post Saturday, saying it expects that when farmers tend crops later, “rows won’t be where the AutoPath lines think they are” and that it would be “difficult - if not impossible” for the self-driving tractor feature to work in fields planted while the GPS systems were hampered.

New Attack Against Self-Driving Car AI - Schneier on Security

https://www.schneier.com/blog/archives/2024/05/new-attack-against-self-driving-car-ai.html

This is another attack that convinces the AI to ignore road signs:

Robotaxi parks on woman’s leg after running her over

https://www.telegraph.co.uk/world-news/2023/10/03/san-francisco-cruise-driverless-car-woman-hit-and-run-crash/

The pedestrian was struck in a hit and run collision that threw her into the path of a driverless vehicle that then ran her over, stopping on top of her leg and remaining there until she was rescued by police, a witness told the San Francisco Chronicle.

The woman was admitted to hospital and is in a critical condition after the incident, which required the stationary car to be lifted off the ground, San Francisco’s fire department said.

Self-Driving Cars Are Surveillance Cameras on Wheels - Schneier on Security

https://www.schneier.com/blog/archives/2023/07/self-driving-cars-are-surveillance-cameras-on-wheels.html

Police are already using self-driving car footage as video evidence

Tesla’s ‘Self-Driving’ System Is Likely Involved in Fatal Crashes More Often Than Human Drivers – Pixel Envy

https://pxlnv.com/linklog/tesla-crash-safety-record/

Mercedes-Benz is the first to bring Level 3 automated driving to the US - The Verge

https://www.theverge.com/2023/1/27/23572942/mercedes-drive-pilot-level-3-approved-nevada

The company’s Drive Pilot system is approved for use in Nevada, but only at speeds up to 40 mph.

Level 3 systems are not without their risks. Most autonomous vehicle operators, including Waymo and Cruise, have said they think Level 3 is too dangerous, preferring to work exclusively on Level 4 technology. The reason is the need for drivers to stay attentive despite the vehicle performing most of the driving tasks.

There have been studies that show that hand-off between automated system and human driver can be especially fraught. When people have been disconnected from driving for a longer period of time, they may overreact when suddenly taking control in an emergency situation. They may overcorrect steering, brake too hard, or be unable to respond correctly because they hadn’t been paying attention.

Driverless Robotaxi Fleet Paralyzed for Hours in San Francisco

https://thelastdriverlicenseholder.com/2022/06/29/driverless-robotaxi-fleet-paralyzed-for-hours-in-san-francisco/

Apparently, the first system breakdown of a driverless robot taxi fleet occurred. In San Francisco, at least a dozen autonomous Chevrolet Bolts from GM Cruise Automation were spotted blocking the intersection at Gough Street and Fulton Street for a couple of hours

Driver must stand trial for deadly Tesla crash in California - AP News

https://apnews.com/article/technology-california-los-angeles-a8412a63a4e392e95a47da1b4a539a68

The driver of a Tesla operating on autopilot must stand trial for a crash that killed two people in a Los Angeles suburb, a judge ruled Thursday.

Toyota pauses Paralympics self-driving buses after one hits visually impaired athlete - Self-driving cars - The Guardian

https://www.theguardian.com/technology/2021/aug/28/toyota-pauses-paralympics-self-driving-buses-after-one-hits-visually-impaired-athlete

Japan’s Aramitsu Kitazono was left with cuts and bruises after being hit by the e-Palette vehicle at the athletes’ village