Or click here to watch the video.Despite the obvious privacy concerns, Kain pitches his invention primarily as a helpful tool for Tesla owners who rate above average on the paranoia spectrum. "It turns your Tesla into an AI-powered surveillance station," Kain says. "It's meant to be another set of eyes, to help out and tell you it's seen a license plate following you over multiple days, or even multiple turns of a single trip."Kain, a consultant for the security firm Tevora, also isn't oblivious to his creation's creep factor. He says the Surveillance Detection Scout demonstrates the kind of surveillance the data that self-driving cars already collect could enable. If a large group of Surveillance Detection Scout users were to combine their license plate recognition data—a feature that Kain has purposefully left out of the software—the system could create a crowdsourced version of the same powerful surveillance provided by commercial automatic license plate reader systems, whose use by police has been banned in some states. "I’d be able to see everyone across the US, thousands of cars on this Surveillance Scout network," Kain says. "So I think there’s a real ethical issue there."
A Panopticon in Your ConsoleThe Surveillance Detection Scout prototype, whose software Kain has made available on Github, works by capturing and analyzing the video from a Tesla's three cameras—two on its sideview mirrors and one forward-facing—on a $700 Nvidia Jetson Xavier mini-computer. It uses an open source neural network framework called Darknet as its machine learning engine, along with ALPR Unconstrained for recognizing license plates and Facenet for tracking faces. Both of those programs are available for free on Github. The system also uses Google's Open Images Dataset as training data."I’m not doing any cutting-edge AI," Kain says. "I’m just applying what’s already freely available, off the shelf." The software even identifies the make and model of cars it sees based on license plate lookups on the service FindByPlate.com. (Kain says it's far harder to link license plates to actual names, and he doesn't intend to include that data in his tool.)Kain says he came up with the idea for his follower detection mechanism last year after he attended a talk on countersurveillance at last year's Defcon. He'd been thinking since he first bought his Tesla Model 3 about the gigabytes of video it collected and deleted, overwriting its video logs every hour. "I had a little bit of FOMO, thinking about how all this video is gone if I don't do something with it," Kain says.After learning about a tool available on Github called Tesla USB that allows Tesla owners to store their video to an external drive indefinitely, Kain came up with the idea of combining that storage capability with image recognition to give his car features similar to the Nest camera in his home, which includes so-called "familiar face detection." Beyond tracking license plates, the face detection element of his tool also functions as what he describes as an upgrade to Tesla's existing Sentry security system, which starts recording when someone touches your car and sets off an alarm if they attempt to break into it.
By stitching together a patchwork of public code, Kain's 4-inch-cubed box can recognize license plate numbers and faces from the car's video stream and alert the car's owner if it spots repeated plates or faces in that data. It uses the software integration tool If This Then That to send alerts. By default, the system will notify the driver if it sees the same car following for every minute over a five-minute span, though Kain says the settings can be adjusted to the driver's preference. The notifications have about a one-minute delay, Kain says, because of the time a Tesla's cameras take to record a video file. And for now, users have to set up their own web server for it to work, though Kain says he may offer simpler web-based logins on his own server in the future.
'A Surveillance Camera on Wheels'
Kain proposes some scenarios where his system could do some good: confidential sources meeting with a journalist, or anyone else who has reason to believe they're being followed or targeted by snoops. "If it helps keeps someone safe, that’s great," Kain says. "If it lets me know that someone’s sneaking around my car, that’s also great."
Andy Greenberg is a WIRED security writer and author of the forthcoming book, Sandworm: A New Era of Cyberwar and the Hunt for the Kremlin's Most Dangerous Hackers.The Surveillance Detection Scout, however, faces not just ethical issues but also legal ones, says Joseph Lorenzo Hall, the chief technologist with the Center for Democracy and Technology. State laws against automatic license place readers, even for private use, would likely make it illegal in Arkansas, Georgia, Maine, and New Hampshire. Its facial recognition features make it illegal in Illinois.Laws aside, Hall argues that Kain's invention could have unintended consequences and serious privacy implications. Confrontations could result from false positives, he says, if a driver mistakenly believes they're being followed by someone who happens to have the same commute. "I’m worried about the subjective judgment a human would make from this technological system," says Hall. "That could result in people pulling guns on each other when there's really nothing to worry about."
Hall also worries more broadly worry about the widespread form of AI-enabled surveillance that the system represents, particularly if its users tweaked Kain's code to share their data with each other. "You're going to have very rich records of people’s movements," Hall says. "It’s essentially a surveillance camera on wheels, not providing anyone notice of that fact, mapping pieces of people's paths through the cities they live in."Even more troubling, Hall says, would be the potential for law enforcement to gain access to the data, either through some sort of incentive to drivers—just as local police in some cities have subsidized Amazon's Ring home surveillance cameras as a way to access their data —or by compelling users to share it with subpoenas.
Kain says he's aware of those concerns, and built his system in part to demonstrate the possibilities of self-driving cars' video surveillance before a shady commercial startup could do it first—one that might aggregate the data between users rather than keep it separated. A new era of ubiquitous self-driving car video data collection is coming, he says, and that much of it may end up on centralized repositories.
But he also admits that someone could easily tweak his code to enable data sharing between users, taking a big step toward the very future he warns about. "It would be trivial for someone to build that in if they have any development experience," Kain says. "Is it a slippery slope? Potentially."
- How scientists built a “living drug” to beat cancer
- Hey, Apple! “Opt out” is useless. Let people opt in
- Big banks could soon jump on the quantum bandwagon
- The terrible anxiety of location sharing apps
- Now even funerals are livestreamed
- 🏃🏽♀️ Want the best tools to get healthy? Check out our Gear team’s picks for the best fitness trackers , running gear (including shoes and socks ), and best headphones .
- 📩 Get even more of our inside scoops with our weekly Backchannel newsletter
- #facial recognition