<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Everyone&#8217;s a Metacritic: Why aggregating game reviews is absurd</title>
	<atom:link href="http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/</link>
	<description>Gadgets, gear and computer hardware.</description>
	<lastBuildDate>Sat, 05 Dec 2009 12:04:43 -0500</lastBuildDate>
	
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: Ben Frazier</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-1153305</link>
		<dc:creator>Ben Frazier</dc:creator>
		<pubDate>Thu, 03 Dec 2009 05:21:45 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-1153305</guid>
		<description>I think there are games graded differently on consoles because of special features for a particular platform as well as controls and online play.</description>
		<content:encoded><![CDATA[<p>I think there are games graded differently on consoles because of special features for a particular platform as well as controls and online play.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: NathanZ</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-977927</link>
		<dc:creator>NathanZ</dc:creator>
		<pubDate>Wed, 04 Feb 2009 05:48:01 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-977927</guid>
		<description>I&#039;m not sure I understand the nature of the argument against assigning a numeric value to game preferences. Sure, there is the problem of the heap or problem of the beard as they talk about in philosophy (IE no one can point out at what point a number of grains or a number of hairs on a face become a heap or beard respectively). So, sure, we can&#039;t say all that well the difference between 9.0 and 9.1. That doesn&#039;t mean there is no discernable difference between 8.0 and 9.0--quantification is fuzzy, but that doesn&#039;t mean it is not useful.
In fact, its being fuzzy is the best possible argument FOR using critic compilers: if the difference between fuzzy values is often a case of &#039;what the reviewer had for breakfast&#039;, compiling and averaging is the most likely to yield an accurate and consistent metric for a game&#039;s overall value.

So sure, we all have trouble picking out the difference between two colors which are right next to one another on the color wheel, but that doesn&#039;t mean we lack color vision.
To the author of this article: learn not to extend your claims so far beyond the strength of your arguments that you come off as simply absurd.</description>
		<content:encoded><![CDATA[<p>I&#8217;m not sure I understand the nature of the argument against assigning a numeric value to game preferences. Sure, there is the problem of the heap or problem of the beard as they talk about in philosophy (IE no one can point out at what point a number of grains or a number of hairs on a face become a heap or beard respectively). So, sure, we can&#8217;t say all that well the difference between 9.0 and 9.1. That doesn&#8217;t mean there is no discernable difference between 8.0 and 9.0&#8211;quantification is fuzzy, but that doesn&#8217;t mean it is not useful.<br />
In fact, its being fuzzy is the best possible argument FOR using critic compilers: if the difference between fuzzy values is often a case of &#8216;what the reviewer had for breakfast&#8217;, compiling and averaging is the most likely to yield an accurate and consistent metric for a game&#8217;s overall value.</p>
<p>So sure, we all have trouble picking out the difference between two colors which are right next to one another on the color wheel, but that doesn&#8217;t mean we lack color vision.<br />
To the author of this article: learn not to extend your claims so far beyond the strength of your arguments that you come off as simply absurd.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Going to the movies? Who do you trust? &#124; Spark &#124; CBC Radio</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-976032</link>
		<dc:creator>Going to the movies? Who do you trust? &#124; Spark &#124; CBC Radio</dc:creator>
		<pubDate>Thu, 29 Jan 2009 14:01:08 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-976032</guid>
		<description>[...] Guru), but not everyone agrees with the practice. Nicholas Deleon over at Crunchgear, for example, thinks these sites are &quot;dumb&quot; when they apply this thinking to video game reviews: I dislike the practice of aggregating review [...]</description>
		<content:encoded><![CDATA[<p>[...] Guru), but not everyone agrees with the practice. Nicholas Deleon over at Crunchgear, for example, thinks these sites are &quot;dumb&quot; when they apply this thinking to video game reviews: I dislike the practice of aggregating review [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Enemy Territory developer hates Metacritic&#8217;s influence</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-972742</link>
		<dc:creator>Enemy Territory developer hates Metacritic&#8217;s influence</dc:creator>
		<pubDate>Wed, 21 Jan 2009 19:21:02 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-972742</guid>
		<description>[...] continue now with a thesis developed late last year, that Metacritic is, in so many words, dumb. This Web site magically condense a game&#8217;s every review into a single, bite-sized number. In [...]</description>
		<content:encoded><![CDATA[<p>[...] continue now with a thesis developed late last year, that Metacritic is, in so many words, dumb. This Web site magically condense a game&#8217;s every review into a single, bite-sized number. In [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: GamingAnalyst</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-952890</link>
		<dc:creator>GamingAnalyst</dc:creator>
		<pubDate>Fri, 28 Nov 2008 02:57:03 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-952890</guid>
		<description>L. M. Lloyd,

Did you actually read what anyone said?  No one has said they would use a metacritic score to judge how good a game was to play, how much they would enjoy it.  

Read what I said.  Games with good metacritic scores sell more.  I highly doubt this is a causal relationship, its not the metacritic score that is causing the sales.  Could be a good game, or good advertising, or whatever... 

Doesn&#039;t matter, the score predicts sales relatively well.  

So do you have a good source that discloses advertising budgets by title that I can use instead of metacritic?</description>
		<content:encoded><![CDATA[<p>L. M. Lloyd,</p>
<p>Did you actually read what anyone said?  No one has said they would use a metacritic score to judge how good a game was to play, how much they would enjoy it.  </p>
<p>Read what I said.  Games with good metacritic scores sell more.  I highly doubt this is a causal relationship, its not the metacritic score that is causing the sales.  Could be a good game, or good advertising, or whatever&#8230; </p>
<p>Doesn&#8217;t matter, the score predicts sales relatively well.  </p>
<p>So do you have a good source that discloses advertising budgets by title that I can use instead of metacritic?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Bragaincell High Definition Gold Plated 6 Feet Premium HD Component Cable for Nintendo Wii</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-952588</link>
		<dc:creator>Bragaincell High Definition Gold Plated 6 Feet Premium HD Component Cable for Nintendo Wii</dc:creator>
		<pubDate>Thu, 27 Nov 2008 12:58:18 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-952588</guid>
		<description>[...] Everyone&#8217;s a Metacritic: Why aggregating game reviews is absurd [...]</description>
		<content:encoded><![CDATA[<p>[...] Everyone&#8217;s a Metacritic: Why aggregating game reviews is absurd [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: L. M. Lloyd</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-952542</link>
		<dc:creator>L. M. Lloyd</dc:creator>
		<pubDate>Thu, 27 Nov 2008 09:44:07 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-952542</guid>
		<description>I find it odd, and somewhat disturbing that people are actually forwarding the argument that a good metacritic score equates to good sales, therefore it is an important metric. You know what else equates to good sales? How big an ad budget you have for your product. 

In fact, it takes a huge leap of faith to say that the review score has any effect on sales at all, given how closely game review scores seem to track ad budget. Just doing a quick check of several AAA titles, I had a really hard time finding a single one with a score under 80. Even big budget games universally accepted by critics as being far from one of the best games ever, still came in with scores of 80 or above. Even in series where some titles are universally accepted as being far superior to other installments of the series, the entire point range of the series is rarely over 5 points.

What is even more interesting is to see how radically scores of the same game fluctuate based on platform, and how heavily it was advertised on the given platform. Not to get too specific, but a few examples would be Halo 2 Xbox: 95 PC: 72, Skies of Arcadia Dreamcast: 93 Gamecube: 84, Grandia II Dreamcast: 89, PS2: 68, PC: 70. These are the same games, just with different release dates, and different marketing budgets. Sure, there might be some porting differences, but 20 or 30 points worth?

The argument seems to be:

Good scores = good sales = good game = scores are an important measure of the quality of the game.

However, you could just as well have the scenario where:

Good ad budget = good sales = good scores = scores are just another part of a publisher&#039;s advertising arsenal, and have nothing to do with the quality of the game.

I have to agree with the author that scores have almost no meaning. At best they might be seen as a gauge of how popular a game is (which is in no way the same as how good a game is), and at worst they are just a metric judging how many ad dollars the publisher had to throw around.</description>
		<content:encoded><![CDATA[<p>I find it odd, and somewhat disturbing that people are actually forwarding the argument that a good metacritic score equates to good sales, therefore it is an important metric. You know what else equates to good sales? How big an ad budget you have for your product. </p>
<p>In fact, it takes a huge leap of faith to say that the review score has any effect on sales at all, given how closely game review scores seem to track ad budget. Just doing a quick check of several AAA titles, I had a really hard time finding a single one with a score under 80. Even big budget games universally accepted by critics as being far from one of the best games ever, still came in with scores of 80 or above. Even in series where some titles are universally accepted as being far superior to other installments of the series, the entire point range of the series is rarely over 5 points.</p>
<p>What is even more interesting is to see how radically scores of the same game fluctuate based on platform, and how heavily it was advertised on the given platform. Not to get too specific, but a few examples would be Halo 2 Xbox: 95 PC: 72, Skies of Arcadia Dreamcast: 93 Gamecube: 84, Grandia II Dreamcast: 89, PS2: 68, PC: 70. These are the same games, just with different release dates, and different marketing budgets. Sure, there might be some porting differences, but 20 or 30 points worth?</p>
<p>The argument seems to be:</p>
<p>Good scores = good sales = good game = scores are an important measure of the quality of the game.</p>
<p>However, you could just as well have the scenario where:</p>
<p>Good ad budget = good sales = good scores = scores are just another part of a publisher&#8217;s advertising arsenal, and have nothing to do with the quality of the game.</p>
<p>I have to agree with the author that scores have almost no meaning. At best they might be seen as a gauge of how popular a game is (which is in no way the same as how good a game is), and at worst they are just a metric judging how many ad dollars the publisher had to throw around.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: GamingAnalyst</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-952271</link>
		<dc:creator>GamingAnalyst</dc:creator>
		<pubDate>Wed, 26 Nov 2008 20:30:11 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-952271</guid>
		<description>Agree with Detlev - it depends on what you use the Metacritic score for.  The author is missing the value that many of us do derive.

The Metacritic score for a game title is very highly correlated with sales for that title and highly predictive of sales. 

Would I personally buy a game based on a high metacritic score?  No.
Would I bet that on a games &#039;box office&#039; base on metacritic score?  Yes.</description>
		<content:encoded><![CDATA[<p>Agree with Detlev &#8211; it depends on what you use the Metacritic score for.  The author is missing the value that many of us do derive.</p>
<p>The Metacritic score for a game title is very highly correlated with sales for that title and highly predictive of sales. </p>
<p>Would I personally buy a game based on a high metacritic score?  No.<br />
Would I bet that on a games &#8216;box office&#8217; base on metacritic score?  Yes.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Dave P</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-952146</link>
		<dc:creator>Dave P</dc:creator>
		<pubDate>Wed, 26 Nov 2008 17:48:17 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-952146</guid>
		<description>Being in the industry myself, it is common for independent game developers next gig to depend on it&#039;s last product&#039;s Metacritic score.  

For the uninitiated, game developers actually make the products, and game publishers generally fund, market and distribute them.  A product&#039;s success or failure depends not only the developer&#039;s execution, but the publisher&#039;s control (they have all the cards).  If a game is misdirected or unsupported via marketing by a publisher, this also leads to low Metacritic scores.  

So the developer Metacritic fate - whether the developer is competent or not - is largely in the hands of the publisher.  

All told, your &quot;industry killing&quot; description is apt, given that those actually making the products are being driven out of business largely due to Metacritic&#039;s influence.</description>
		<content:encoded><![CDATA[<p>Being in the industry myself, it is common for independent game developers next gig to depend on it&#8217;s last product&#8217;s Metacritic score.  </p>
<p>For the uninitiated, game developers actually make the products, and game publishers generally fund, market and distribute them.  A product&#8217;s success or failure depends not only the developer&#8217;s execution, but the publisher&#8217;s control (they have all the cards).  If a game is misdirected or unsupported via marketing by a publisher, this also leads to low Metacritic scores.  </p>
<p>So the developer Metacritic fate &#8211; whether the developer is competent or not &#8211; is largely in the hands of the publisher.  </p>
<p>All told, your &#8220;industry killing&#8221; description is apt, given that those actually making the products are being driven out of business largely due to Metacritic&#8217;s influence.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Detlev</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-952141</link>
		<dc:creator>Detlev</dc:creator>
		<pubDate>Wed, 26 Nov 2008 17:43:11 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-952141</guid>
		<description>As a past employee of a very large game developer/publisher, I was explicity told that there was a direct correlation between revenue and Metacritic score. Right or wrong (and there&#039;s no argument from me on your points above), the truth of the relationship remains. Higher score means more money. Until that connective tissue is dissolved, expect Metacritic and its ilk to keep steaming along, even with dubious value.</description>
		<content:encoded><![CDATA[<p>As a past employee of a very large game developer/publisher, I was explicity told that there was a direct correlation between revenue and Metacritic score. Right or wrong (and there&#8217;s no argument from me on your points above), the truth of the relationship remains. Higher score means more money. Until that connective tissue is dissolved, expect Metacritic and its ilk to keep steaming along, even with dubious value.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: BK888</title>
		<link>http://www.crunchgear.com/2008/11/26/everyones-a-metacritic-why-aggregating-game-reviews-is-absurd/comment-page-1/#comment-952136</link>
		<dc:creator>BK888</dc:creator>
		<pubDate>Wed, 26 Nov 2008 17:10:12 +0000</pubDate>
		<guid isPermaLink="false">http://www.crunchgear.com/?p=55710#comment-952136</guid>
		<description>Newegg, Amazon, and many other companies aggregate reviews.  The average is an interesting value since it gives you an idea of general trends.  You then have the option to read a selection of reviews.  It&#039;s rare to find a movie or game reviewer you agree with 100% for a variety of reasons so it&#039;s good to see the positive and the negative so you can make a more informed opinion.

Some game reviewers will get caught up in trivial issues and use that to batter a game.  Others will overlook key flaws and give a game a glowing review.  The more varied the reviews the more you know to take care before buying.

If every game reviewer pans a game, then it&#039;s a pretty good sign you might want to stay away.

Far better to use these sites than to rely on folks at Penny Arcade or Shacknews who gush about mediocre games in the hopes of getting the social support they need to appreciate the purchase they made.

Aggregators will always be useful.  But it&#039;s up to the reader to make best use of them.</description>
		<content:encoded><![CDATA[<p>Newegg, Amazon, and many other companies aggregate reviews.  The average is an interesting value since it gives you an idea of general trends.  You then have the option to read a selection of reviews.  It&#8217;s rare to find a movie or game reviewer you agree with 100% for a variety of reasons so it&#8217;s good to see the positive and the negative so you can make a more informed opinion.</p>
<p>Some game reviewers will get caught up in trivial issues and use that to batter a game.  Others will overlook key flaws and give a game a glowing review.  The more varied the reviews the more you know to take care before buying.</p>
<p>If every game reviewer pans a game, then it&#8217;s a pretty good sign you might want to stay away.</p>
<p>Far better to use these sites than to rely on folks at Penny Arcade or Shacknews who gush about mediocre games in the hopes of getting the social support they need to appreciate the purchase they made.</p>
<p>Aggregators will always be useful.  But it&#8217;s up to the reader to make best use of them.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
