Researchers in the College of Information Sciences and Technology (IST) copied Google results pages from four different e-commerce queries, ascribing them to four different search engines -- Google, MSN Live Search, Yahoo! and an in-house engine created for the study. Then the researchers showed the pages to 32 study participants who were asked to evaluate the engines’ performance in returning relevant results.
The queries included “camping Mexico,” “laser removal,” “manufactured home” and “techno music.”
Despite the results pages being identical in content and presentation, participants indicated that Yahoo! and Google outperformed MSN Live Search and the in-house search engine.
“Given that there was no difference in the results, all of the search engines should have had the exact same score,” said Jim Jansen, assistant professor and lead researcher. “Some emotional branding is having an effect here.” Jansen and co-author, Mimi Zhang, an IST graduate student, detailed the study in a paper, “The Effect of Brand Awareness on the Evaluation of Search Engine Results,” at the recent Computer/Human Interaction 2007 Conference in San Jose, Calif.
The researchers were motivated to understand why Web users gravitate toward a handful of search engines when there are about 4,000 search engines that have similar technologies and similar interfaces. The performance -- defined as the ratio of relevant documents to the total number returned at some point in the results listing -- of those search engines also is practically the same.
To determine each engine's “performance,” participants rated the returned results on a three-point scale: very relevant, somewhat relevant, and not relevant. After averaging the scores, the researcher determined an average -- about 36 percent of all results were judged relevant to the query.
The researchers then looked at each engine’s “score” to determine whether it fell above or below the average.
Participants ranked results from Yahoo! more relevant across the four queries.
Given that many of the participants said they used Google to search, Jansen said he was surprised that Yahoo! came out on top. Its total scores were 15 percent above the average for the four queries while Google’s total scores were just 0.7 percent above the average. Future research will consider whether participants “carried over” satisfaction with other products when ranking search engines, Jansen said.
AI2RS, the search engine created in-house with no brand-name recognition, fared the worst. The researchers calculated its average precision rating as 10 percent below the average although AI2RS had the highest score when the query was “laser removal.”
The study ties branding not just to product identification but also to product performance, Jansen said.
Margaret Hopkins | EurekAlert!
The Great Unknown: Risk-Taking Behavior in Adolescents
19.01.2017 | Max-Planck-Institut für Bildungsforschung
A sudden drop in outdoor temperature increases the risk of respiratory infections
11.01.2017 | University of Gothenburg
An important step towards a completely new experimental access to quantum physics has been made at University of Konstanz. The team of scientists headed by...
Yersiniae cause severe intestinal infections. Studies using Yersinia pseudotuberculosis as a model organism aim to elucidate the infection mechanisms of these...
Researchers from the University of Hamburg in Germany, in collaboration with colleagues from the University of Aarhus in Denmark, have synthesized a new superconducting material by growing a few layers of an antiferromagnetic transition-metal chalcogenide on a bismuth-based topological insulator, both being non-superconducting materials.
While superconductivity and magnetism are generally believed to be mutually exclusive, surprisingly, in this new material, superconducting correlations...
Laser-driving of semimetals allows creating novel quasiparticle states within condensed matter systems and switching between different states on ultrafast time scales
Studying properties of fundamental particles in condensed matter systems is a promising approach to quantum field theory. Quasiparticles offer the opportunity...
Among the general public, solar thermal energy is currently associated with dark blue, rectangular collectors on building roofs. Technologies are needed for aesthetically high quality architecture which offer the architect more room for manoeuvre when it comes to low- and plus-energy buildings. With the “ArKol” project, researchers at Fraunhofer ISE together with partners are currently developing two façade collectors for solar thermal energy generation, which permit a high degree of design flexibility: a strip collector for opaque façade sections and a solar thermal blind for transparent sections. The current state of the two developments will be presented at the BAU 2017 trade fair.
As part of the “ArKol – development of architecturally highly integrated façade collectors with heat pipes” project, Fraunhofer ISE together with its partners...
19.01.2017 | Event News
10.01.2017 | Event News
09.01.2017 | Event News
19.01.2017 | Physics and Astronomy
19.01.2017 | Health and Medicine
19.01.2017 | Ecology, The Environment and Conservation