HPCwire: Carnegie Mellon, French Researchers Develop Visual Data Mining Software

Since 1986 - Covering the Fastest Computers
in the World and the People Who Run Them

Translation Disclaimer

Subscribe | Sign In

Tabor Communications
Corporate Video

August 07, 2012

Carnegie Mellon, French Researchers Develop Visual Data Mining Software

PITTSBURGH, PA, Aug. 7 -- Paris is one of those cities that has a look all its own, something that goes beyond landmarks such as the Eiffel Tower or Notre Dame. Researchers at Carnegie Mellon University andINRIA/Ecole Normale Supérieure in Paris have developed visual data mining software that can automatically detect these sometimes subtle features, such as street signs, streetlamps and balcony railings, that give Paris and other cities a distinctive look.

The software analyzed more than 250 million visual elements gleaned from 40,000 Google Street View images of Paris, London, New York, Barcelona and eight other cities to find those that were both frequent and could be used to discriminate one city from the others. This yielded sets of geo-informative visual elements unique to each city, such as cast-iron balconies in Paris, fire escapes in New York City and bay windows in San Francisco.

The discovered visual elements can be useful for a variety of computational geography tasks. Examples include mapping architectural correspondences and influences within and across cities, or finding representative elements at different geo-spatial scales such as a continent, a city, or a specific neighborhood.

Researchers will present their findings Aug. 9 at SIGGRAPH 2012, the International Conference on Computer Graphics and Interactive Techniques, at the Los Angeles Convention Center.

Alexei Efros, associate professor of robotics and computer science at CMU, noted that although finding patterns in very large databases — so-called Big Data mining —is widely used, it has so far been limited to text or numerical data. “Visual Data is much more difficult, so the field of visual data mining is still in its infancy, but I believe it holds a lot of promise. Our data mining technique was able to go through millions of image patches automatically — something that no human would be patient enough to do,” said Efros, who collaborated with colleagues including Abhinav Gupta, assistant research professor of robotics, and Carl Doersch, a Ph.D. student in CMU’s Machine Learning Department. “In the long run, we wish to automatically build a digital visual atlas of not only architectural but also natural geo-informative features for the entire planet.”

For this study, the researchers started with 25,000 randomly selected visual elements from city images gathered from Google Street View. A machine learning program then analyzed these visual elements to determine which details made them different from similar visual elements in other cities. After several iterations, the software identified the top-scoring patches for identifying a city. For Paris, those patches corresponded to doors, balconies, windows with railings, street signs (the shape and color of the signs, not the street names on the signs), and special Parisian lampposts. It had more trouble identifying geo-informative elements for U.S. cities, which the researches attributed to the relative lack of stylistic coherence in American cities with their melting pot of styles and influences.

“We let the data speak for itself,” said Gupta, noting the entire process is automated, yet produces a set of images that convey a better stylistic feel for a city than a set of random images.

Doersch said this process requires a significant amount of computing time, keeping 150 processors working overnight. By comparison, art directors for the 2007 Pixar movie “Ratatouille” spent a week running around Paris taking photos so they could capture the look and feel of Paris in their computer model of the city.

More information, including a video, is available on the project website, http://graphics.cs.cmu.edu/projects/whatMakesParis/.

In addition to Efros, Gupta and Doersch, the research team included Saurabh Singh, a former research assistant in the Robotics Institute, and Josef Sivic, a researcher at INRIA / Ecole Normale Supérieure.

About Carnegie Mellon University: Carnegie Mellon (www.cmu.edu) is a private, internationally ranked research university with programs in areas ranging from science, technology and business, to public policy, the humanities and the arts. More than 11,000 students in the university’s seven schools and colleges benefit from a small student-to-faculty ratio and an education characterized by its focus on creating and implementing solutions for real problems, interdisciplinary collaboration and innovation. A global university, Carnegie Mellon’s main campus in the United States is in Pittsburgh, Pa. It has campuses in California’s Silicon Valley and Qatar, and programs in Asia, Australia, Europe and Mexico. The university is in the midst of “Inspire Innovation: The Campaign for Carnegie Mellon University,” which aims to build its endowment, support faculty, students and innovative research, and enhance the physical campus with equipment and facility improvements.

-----

Source: Carnegie Mellon University

Share Options

Subscribe

Subscribe to HPCwire

Discussion

There are 0 discussion items posted.

Join the Discussion

Become a Registered User Today!

Registered Users Log in join the Discussion

RSS Feeds

Feeds by Topic

Feeds by Industry

Feeds by Content Type

Subscribe to All Content

All

August 10, 2012

August 09, 2012

August 08, 2012

August 07, 2012

August 06, 2012

August 03, 2012

ARM Submits GPU for OpenCL Conformance

August 02, 2012

August 01, 2012

July 31, 2012

Feature Articles

AMD Unveils Teraflop GPU with ECC Support

Advanced Micro Devices (AMD) has launched six new FirePro processors for workstation users who want high-end graphics and computation in a single box. One of them promises a teraflop of double precision performance as well as support for error correcting code (ECC) memory. The new offerings also includes two APUs (Accelerated Processing Units) that glue four CPU cores and hundreds of FirePro GPU stream cores onto the same chip.
Read more...

Steven Reiner Urges Scientists to Tell Their Stories

At the annual Extreme Science and Engineering Discovery Environment (XSEDE) conference in Chicago, journalist Steven Reiner talked about the crucial role scientists play in educating the public about their work. A lifelong journalist and Emmy-award winning producer, Reiner believes it is essential to our society that researchers explain what they do, how they do it, and why it is important. “Scientists have a responsibility to share the meaning and implications of their work,” he said.
Read more...

Proving the Case for Climate Change with Hi-Res Models

Although serious scientists believe we’re past the point of debating the validity of climate change, the computer models that support this research are not perfect. Fortunately, the latest improvements to high-resolution climate simulations are not only improving the fidelity of the models, but are also deepening our understanding of climate dynamics, both qualitatively and quantitatively.
Read more...