Showing posts from May, 2012

Do Human Raters Have A Direct Influence on Google’s Search Results?

Not surprisingly, Google takes search result evaluation rather seriously. Exact evaluation enables Google’s teams to find out "which way is up" . One of Google’s principles in search quality is to rely on data in its decision-making. Google tries hard not to count on anecdotal fictions, which are mostly misleading in search and where hundreds of millions of searches a day can be affected. Statistically-meaningful evaluation gives Google the data needed to create real improvements. Matt Cutts about how Google uses human raters   Evaluating search algorithms is difficult for several reasons: