AI Is Scarily Good at Guessing the Location of Random Photos

Wow:

To test PIGEON’s performance, I gave it five personal photos from a trip I took across America years ago, none of which have been published online. Some photos were snapped in cities, but a few were taken in places nowhere near roads or other easily recognizable landmarks.

That didn’t seem to matter much.

It guessed a campsite in Yellowstone to within around 35 miles of the actual location. The program placed another photo, taken on a street in San Francisco, to within a few city blocks.

Not every photo was an easy match: The program mistakenly linked one photo taken on the front range of Wyoming to a spot along the front range of Colorado, more than a hundred miles away. And it guessed that a picture of the Snake River Canyon in Idaho was of the Kawarau Gorge in New Zealand (in fairness, the two landscapes look remarkably similar).

This kind of thing will likely get better. And even if it is not perfect, it has some pretty profound privacy implications (but so did geolocation in the EXIF data that accompanies digital photos).

Posted on December 29, 2023 at 7:03 AM9 Comments

Comments

Pajeet Narendra December 29, 2023 9:13 AM

Saar,

My name is Pajeet Nerandra and I’m too much honor to meet you saar. I want do PhD on securinfomatics and need suppervazor. please help me be suppervazor I am too much honour saar.

soon forward look to meet you.

yours faithfully
pajeet

emily’s post December 29, 2023 12:01 PM

All right PIGEON’s, where was that hill high on which I left my heart, and where was that foggy day that had me low and had me down ? Let’s rumble.

Clive Robinson December 29, 2023 12:32 PM

@ All,

In the article it is noted that Jay Stanley senior policy analyst at the ACLU who specialises in technology, is concerned that it could easily be used to expose information about individuals that they never intended to share. Further he wories about who would use such technology,

“Stanley worries that similar technology, which he feels will almost certainly become widely available, could be used for government surveillance, corporate tracking or even stalking.”

To which I would add the various forms of Federal, State, Civil, and corporate “Guard Labour”, who are always,

“Looking to do more with less resources”.

Or more correctly do nothing with what every they can grab[1]. If they think you are guilty just because you are on their arbitary short list, then they will only persue that which will convict you…

The only preventative legislation against this sort of use of techbology was written in times before the technology existed, and when that sort of surveillance required considerable and expensive human resources, thus was almost “naturally self limiting”.

As some might have noticed such technology is not just new but very inexpensive, in fact rediculously so. This means that the old legal limitations on such surveillance now nolonger exists or are totally ineffectivective. Thus causing the very serious defects of the old legislative process that relied solely on cost to minimise bad behaviours are now very painfully apparent.

This is only going to get worse with the likes of Palantir who’s basic business model is to significantly under cut the cost of law enformance detectives and inteligence analysts. So get them replaced with “computer algorithms” the price of which they will jack up on the same business model that illegal substance dealers use to turn children into profit.

People still chide me for making sure I do not appear in photographs or audio recordings, even though I’ve been quite strict about it since the 1980’s. I sometimes wonder how long it will be before they actually take onboard my reasons…

Hopefully they will not find out the hard way, why being circumspect and nearly anonymous can be “good for your health”.

Think of it as the modern form of,

“Give me six lines…”

[1] Contrary to what people think, guard labour has little or no interest in either justice or correctly solving crime. As I’ve noted before their process is,

1, Build a list of suspects.
2, Prune the list down.
3, Look not for evidence but what a prosecutor can use to confound a jury thus get them to believe in nonsense to obtain a conviction.
4, Get any kind of conviction to keep politicians / funds holders happy.

That is once you are on the guard labours short list they immediately fail to carry out one of their primary requirments which is that of “impartiality”. That is they don’t look for, ignore, or hide information that might show you are innocent, so they can get the case closed quickly and most importantly as cheaply as possible.

EvilKiru December 29, 2023 12:38 PM

Is the software actually good at finding locations based on image matching or is it just reading the location data from the image file’s meta data and marking the position on a map with the location being off on some images, either due to GPS inaccuracy or deliberate obscuring of the coordinates?

JonKnowsNothing December 29, 2023 3:44 PM

@EvilKiru, All

re: Is the software actually good at finding locations based on image matching

I was thumbing some images in an iPhone and noticed a popup icon that looked like a “leaf”. It was placed over the image of a tree. The detail says ~”look up plant”.

There is also a ~”lookup location” which I presume comes from geotags on the image.

I’d never seen “look up plant” which is not part of the EXIF metadata.

Something is parsing the image file, but what?

===

ht tps ://en.wikipedia.org/wiki/EXIF

  • Exchangeable image file format (officially Exif, according to JEIDA/JEITA/CIPA specifications) is a standard that specifies formats for images, sound, and ancillary tags used by digital cameras (including smartphones), scanners and other systems handling image and sound files recorded by digital cameras. The specification uses the following existing encoding formats with the addition of specific metadata tags: JPEG lossy coding for compressed image files, TIFF Rev. 6.0 (RGB or YCbCr) for uncompressed image files, and RIFF WAV for audio files (linear PCM or ITU-T G.711 μ-law PCM for uncompressed audio data, and IMA-ADPCM for compressed audio data). It does not support JPEG 2000 or GIF encoded images.

JonKnowsNothing December 29, 2023 3:57 PM

@All

re: iPhone Look Up Plant

It might be that the “Look Up Plant” actually tied to the location data. That data is cross referenced to all the geological features around it. Google satellite type maps of the geo-location showing what surrounds the coordinates. (1)

That might explain how the “Look up plant” was added to the image but it does not explain why “Look up plant” was not added to 2 other images from the same location.

Images are from a forest.

===

1) The Google + NSA project to ID every object at every location on the planet.

Who? December 31, 2023 6:26 PM

Some years ago, someone at my University found a lost USB drive with college assignments from a physics undergrad. No need to say, there was no information useful to find the owner of the work, only a picture of a room (mostly two walls, a TV and some furniture, no windows or persons on it).

Using the EXIF information on the image I found the place were it was took: a intersection where two streets converge. Enough information to find the owner of the USB drive. Sometimes the most simple methods work.

At least at that time we had the choice of removing identifiable metadata from images. Now we just cannot remove identificable information from pictures, as the images themselves are enough. Certainly worrying.

Leave a comment

Login

Allowed HTML <a href="URL"> • <em> <cite> <i> • <strong> <b> • <sub> <sup> • <ul> <ol> <li> • <blockquote> <pre> Markdown Extra syntax via https://michelf.ca/projects/php-markdown/extra/

Sidebar photo of Bruce Schneier by Joe MacInnis.