Showing posts from May, 2012

Do Human Raters Have A Direct Influence on Google’s Search Results?

Not surprisingly, Google takes search result evaluation rather seriously. Exact evaluation enables Google’s teams to find out "which way is up". One of Google’s principles in search quality is to rely on data in its decision-making. Google tries hard not to count on anecdotal fictions, which are mostly misleading in search and where hundreds of millions of searches a day can be affected. Statistically-meaningful evaluation gives Google the data needed to create real improvements. Matt Cutts about how Google uses human raters Evaluating search algorithms is difficult for several reasons: