A new algorithm designed at the University of Toronto has the power profoundly to change the way we find photos among the billions on social media sites such as Facebook and Flickr. The search tool uses tag locations to quantify relationships between individuals, even those not tagged in any given photo.
A new algorithm designed at the University of Toronto has the power profoundly to change the way we find photos among the billions on social media sites such as Facebook and Flickr. This month, the United States Patent and Trademark Office will issue a patent on this technology.
A University of Toronto release reports that the search tool, developed by Parham Aarabi, a professor in the Edward S. Rogers Sr. Department of Electrical & Computer Engineering, and his former Master’s student Ron Appel, uses tag locations to quantify relationships between individuals, even those not tagged in any given photo.
Imagine you and your mother are pictured together, building a sandcastle at the beach. You are both tagged in the photo quite close together. In the next photo, you and your father are eating watermelon. You are both tagged. Because of your close “tagging” relationship with both your mother in the first picture and your father in the second, the algorithm can determine that a relationship exists between those two and quantify how strong it may be.
In a third photo, you fly a kite with both parents, but only your mother is tagged. Given the strength of your tagging relationship with your parents, when you search for photos of your father the algorithm can return the untagged photo because of the very high likelihood he is pictured.
“Two things are happening: we understand relationships, and we can search images better,” says Professor Aarabi.
The nimble algorithm, called relational social image search, achieves high reliability without using computationally intensive object- or facial-recognition software.
“If you want to search a trillion photos, normally that takes at least a trillion operations. It’s based on the number of photos you have,” says Aarabi. “Facebook has almost half a trillion photos, but a billion users — it’s almost a 500 order of magnitude difference. Our algorithm is simply based on the number of tags, not on the number of photos, which makes it more efficient to search than standard approaches.”
The release notes that work on this project began in 2005 in Professor Aarabi’s Mobile Applications Lab, Canada’s first lab space for mobile application development.
Currently the algorithm’s interface is primarily for research, but Aarabi aims to see it incorporated on the back-end of large image databases or social networks. “I envision the interface would be exactly like you use Facebook search — for users, nothing would change. They would just get better results,” says Aarabi.
While testing the algorithm, Aarabi and Appel discovered an unforeseen application: a new way to generate maps. They tagged a few photographs of buildings around the University of Toronto and ran them through the system with a bunch of untagged campus photos. “The result we got was of almost a pseudo-map of the campus from all these photos we had taken, which was very interesting,” says Aarabi.
This work received support from the National Science and Engineering Research Council of Canada. It will be presented at the IEEE International Symposium on Multimedia 10 December 2013.
NOTICE OF DATA BREACH Dear User, We are writing to inform you about a data security issue that may involve your Yahoo account information. What Happened? A copy of certain user account information was stolen from our systems in late 2014 by what we believe is a state-sponsored actor. We are closely coordinating with law...
12:15am EDT Breaking News The hashtag #GasShortage is trending on twitter for Tennessee. It will soon be trending elsewhere. My brother reported to me a few minutes ago that Gas stations in Greensboro NC are out of gas and those truck stops have only about 7000 Gallons as of 1155pm EST. The immediate...
World Peace: The Final Chapter By Brooks Agnew Notes from 04 September 2016 World peace has been cited by pageant misses as their life’s work for more than a century. It is the stuff of happily ever fairy tales and Mendala shifting Disney movies. Guard dropping press releases misled Neville Chamberlain and countless other kings to...
Forgiveness by Luckee1 as heard on 30 August 2016 http://tfrlive.com/luckee-with-truth-frequency-news-66847/ I know when I was a girl, I was told that we had to forgive others. The adults, especially those associated with church, always talked about forgiving others. They also talked about how Jesus died for our forgiveness. They would talk about things like forgive your...
Original post is: Watch as amazing GcMAF treatment kills cancer cells in real time… holistic doctors ‘suicided’ over this stunning breakthrough A breakthrough cancer treatment appears to be the reason why a handful of holistic doctors were recently found “suicided” is now gaining worldwide attention as a potential universal cure for cancer. And new microscopic...