Review aggregator
Review aggregators shape which films get watched, which games get bought, and which companies earn bonuses for their employees. At their core, these systems do something deceptively simple: they collect reviews and ratings of products and services, from films and books to videogames, music, software, hardware, and cars. Then they store those reviews, make them searchable, sell consumer-tendency data to third parties, and build databases that companies use to study their actual and potential customers. What makes aggregators powerful is the comparison they enable. A reader no longer has to hunt across dozens of sources; the aggregate score is right there. But behind that single number sit questions about economic influence, about whether a score can move a stock price, and about what happens when companies start tying employee paychecks to the outcome.
Most review aggregation systems assign a numeric value to each collected review, calibrated to reflect how positive that review is of the work. Those numeric values are then used to calculate an approximate average assessment. The result is one number that stands in for dozens of individual opinions. That translation from prose criticism to a single figure is not a neutral act. Every choice about how to weight a review, which sources to include, and how to handle scores that use different scales introduces assumptions into the final number. The listener who sees a score of, say, seventy-something is seeing the output of those choices, not a simple average of raw opinions. What that number then does in the world is a separate story entirely.
Electronic games represent a category where the economic stakes of aggregate scores are especially visible. Games are expensive to purchase, which means a buyer consulting an aggregate score before spending money has real power over the outcome. The literature widely accepts a strong correlation between sales and aggregated scores. Some companies have gone further and tied royalty payment rates directly to aggregate scores. Employee bonuses have been linked to them as well. Stock prices have also been observed to reflect ratings, as investors read scores as signals of potential sales. This chain of effects, from a critic's star rating to a developer's paycheck, has made manufacturers intensely interested in monitoring their own aggregate performance.
Manufacturers' interest in their own scores has produced a separate category of product: the business-facing review aggregator. Rather than serving consumers who want to compare options, these tools serve companies that want to measure how their products are being received. In the film industry, according to Reuters, big studios pay close attention to aggregators but do not always like to assign much importance to them. That ambivalence captures something real about the industry's relationship with aggregated opinion: the scores are too consequential to ignore, yet too simplified to fully trust. Movie Review Intelligence was one website that collated and analyzed movie reviews specifically, showing how specialized these tools can become within a single sector.
Up Next
Common questions
What is a review aggregator and how does it work?
A review aggregator is a system that collects reviews and ratings of products and services, such as films, books, videogames, music, software, hardware, and cars. It stores those reviews, lets users compare them side by side, and typically calculates an approximate average score by assigning a numeric value to each review based on how positively it rates the work. The system also sells consumer-tendency data to third parties and creates databases companies use to understand their customers.
Do review aggregator scores affect sales?
Yes. It is widely accepted in the literature that there is a strong correlation between sales and aggregated scores. This effect is particularly pronounced in the electronic games category, where purchases are expensive and buyers frequently consult aggregate scores before buying.
Have companies tied employee bonuses to review aggregator scores?
Some companies have tied both royalty payment rates and employee bonuses to aggregate scores. Stock prices have also been observed to reflect aggregate ratings, as investors read those scores as indicators of potential sales.
How do film studios use review aggregators?
According to Reuters, big studios in the film industry pay attention to aggregators but do not always like to assign much importance to them. Specialized tools such as Movie Review Intelligence were built specifically to collate and analyze movie reviews for industry use.
What is a business-facing product review aggregator?
A business-facing product review aggregator is a tool designed for manufacturers rather than consumers. It allows companies to measure and monitor aggregate reviews of their own products, rather than helping buyers compare options across the market.
What types of products do review aggregators cover?
Review aggregators cover a wide range of products and services, including films, books, videogames, music, software, hardware, and cars. Different aggregators may specialize in particular categories, such as the film-specific Movie Review Intelligence website.
All sources
7 references cited across the entry
- 2newsHigh Scores Matter To Game Makers, TooNick Wingfield — 20 September 2007
- 3newsThe studios wake up to the power of Rotten TomatoesLiam Lacey — 26 August 2011
- 4journalOn the Validity of Metacritic in Assessing Game ValueAdams Greenwood-Ericksen et al. — 2013
- 6webMovie review aggregators popular, but do they matter?Reuters — 17 February 2012
- 7newsWhile 3-d falls flat, arthouse movies soarJoe Williams — 2010-08-10