Controversy brewing over integrity of reviews
by 
In a story that has quickly picked up steam as it could demonstrate the current state of video game journalism, Gamespot editor Jeff Gerstmann has been fired. The apparent reason is the score of 6.0 that he had recently given to Kane and Lynch. Advertising for K&L has been prominently featured all over the Gamespot website and Eidos, the publisher of the game, was not pleased and threatened to pull their campaign. The final decision would’ve been made by parent company CNET which handles the advertising and employment for the sites they own.
CNET controls several gaming websites in addition to Gamespot such as GameFAQs, SportsGamer, Game Rankings and Metacritic.
I’ve always felt that reviews were inherently flawed which is why I’ll only post up my thoughts on games and I don’t assign them a score. This topic is something I’ve written about in the past. The scoring is completely arbitrary and the scale generally includes numbers that will never be used. Previews for games will tout the features and improvements and then the review will come and either the positivity continues or it’ll be like those previews never existed as they rip into the game. Many reviewers before even playing the final copy will have an idea of what they are going to score it. As much as I like College Hoops 2K8, there is something wrong when in their review 1Up calls it the best college basketball game of the year when March Madness was still several weeks away. I wonder if MM will be receiving a lower review score than CH?
Reviews are critical to media sites because they generate revenue through advertising. Scores are necessary because of the influence the site holds along with being included in Game Rankings/Metacritic. Sites aren’t approved until they have a certain level of traffic and number of reviews completed. Once they are in their game scores become more important meaning the gaming companies will want to do what they can to positively influence them. That doesn’t necessarily mean leaning on them for certain scores, but it could simply be offering them exclusive content. Once the sites begin receiving those things their hits go up and along with it their advertising revenue.
While this is an important issue in general, I don’t really see this as much of a problem in relation to sports games. Generally (whether right or wrong) the games are compared to the previous year’s version and the competition. There is a base score they work from and a level that they won’t go any higher than. This generation of games haven’t received abnormally high scores. If anything they’ve been pretty hard on the games ranging from the fives to the high eights. And in the end most consumers who buy the games every year aren’t very influenced by the scores unless the consensus is abnormally low or high.
Regardless it just goes to show how little consideration should be given to reviews. Outside influences certainly are present in many cases. In the end they should just be considered as one person’s opinion. That will include any biases they may have. Everyone has some form of them, otherwise they wouldn’t be opinions. Despite the low regard that reviews should be held in it is definitely concerning to hear of such a story and see how money can influence not just individuals but the entire industry.
November 30, 2007 at 7:48 am
Very glad that you brought this up because I’ve been asking the same question to ign and all the other nancy second rate havent proven themselves websites that gave madden a complete 9/10 8/10 and said it was the best one yet. But only for months to come afterwards with as many glitches as the day is long… good topic lets question those reviews shall we?
November 30, 2007 at 8:22 am
[quote comment="6861"]Very glad that you brought this up because I’ve been asking the same question to ign and all the other nancy second rate havent proven themselves websites that gave madden a complete 9/10 8/10 and said it was the best one yet. But only for months to come afterwards with as many glitches as the day is long… good topic lets question those reviews shall we?[/quote]
I think there is something to that. Reviewers usually rush through the game in order to meet a deadline and be the earliest out possible. With sports games they aren’t going years into a franchise mode, they’ll just regurgitate the features lists. They do that with a lot of things such as online play also. Those problems are inherient with all the sports games reviews.
I know after only a few minutes with Madden that I wasn’t thrilled by it, especially due to the fumbles, injuries, over-powered kicking, and lack of pass protection. How do you interpret those type of things when combining with everything else to form a score? I can’t do that, it doesn’t make any sense to me.
If I was to review games I wouldn’t use a number to score it. I would probably do something like rating it on scales of fun, realism, and depth. Again though you get into arbitrary meanings and it still would just be only my opinion.
November 30, 2007 at 8:22 am
I have to be completely honest. I read game reviews and take stock in them. I don’t necessarily care so much about the numbered score as I do in what the actual article has to reveal about the final build. I go on the assumption that the reviewer’s opinion is his/her own, and that they are doing their best to remain impartial in their analysis.
To Kane and Lynch; I was patiently anticipating this title, and Gertsmann’s review wasn’t the only one branding K&L so low. The best score I saw gave it an 8/10, and the lowest 6/10 (on two sites). Needless to say, the reviews made me shy away from the game at full retail price. I found a copy on ebay, along with Madden 08, for $70 (meaning I got both games for a total of $70).
Anyway, shouldn’t Eidos take stock in what the reviewer reveals in his review? If the game is not up to standard, then maybe you should heed the informatioin being given to you, free of charge. Work harder next time to polish up your product. After all, the games are for US to enjoy, not you (Eidos) to rush out.
November 30, 2007 at 9:22 am
In ur screenshot its shows the users rated it 4.0 so whats the problem? I guess if they advertise it they want them to lie bout the ratings?
November 30, 2007 at 9:51 am
Sounds kinda conspiratorial, huh RICO?
November 30, 2007 at 10:28 am
I know once i found out K&L had NO Online Co-Op that was it for me, I was all set with the title. That guy getting fired is BS, but what do you expect from Cnet…..”Chash moves every thing around me, Cream get the Money, Dolla Dolla Bill ya’ll”- or should i say Euro’s…
November 30, 2007 at 10:44 am
To Atom 1 It Cash Rules Everything Around Me (C.R.E.A.M)
November 30, 2007 at 11:36 am
I always wonder as to how a game can get a lower score than another. I think it was IGN that gave NBA 2k8 a 7.9 and gave NBA 08 (Sony) a 7.5. If you play both of the games it becomes very very clear that 08 more than just .4 points away from 2K. Thats why I download the Demo’s if there is one. Ive been waiting for K&L demo and Assassins Creed demo for awhile before I spend $60. Both game received scores in the 7’s. I want to give my own opinion before I buy. As you can see I put alot of worth into what these reviewers say. Pasta thats why Ive been coming to your site. You always put your opinion of the game out. You tell it like it is. Great stuff.
November 30, 2007 at 11:41 am
who cares… if you have interest, rent… then buy… I remember how hard pasta was going for Live, Madden, and all these EA games… Then said Madden was weak, and Live is the best NBA game (in his eyes of the year) Whos to say dude aint getting… C.R.E.M.E. from EA Cats need to judge themselves on what they want… For god sakes he said NBA Live 08 was the best game of the year (one of them), I dont understand this ish…
For god sakes dude went to the Live 08 convention in NY this year… And I dont understand to this day how that game is even playable (rented it AGAIN of the strength of this dude saying give it a chance) and I STILL CANNOT PUMP FAKE! Dont even look next gen…
Yeah I said it,
Peep stuff for yourself…
November 30, 2007 at 3:15 pm
Shoeprint. This is his site. He is here to give his opinion. Just because you dont agree doesnt mean you have to listen. But it doesnt mean you have the right to bash his opinion. I played live and 2k and IMO Live is more playable that 2K. Yeah the both have there problems but to me Live is a great game. Im hoping MM will be the same. I want a good game. 2K has to many issues that prevent someone from enjoying it. BUT, thats my opinion. If you want to have an opinion that people will read and you can get invited to media events come up with your own site. Then and only then do you have to bash someone else opinion.
Yeah I said it.
Thanks for your hard work pasta. Keep on bringing it.
November 30, 2007 at 5:25 pm
Shoe is right. Just look at pasta’s bias. Why do you think he doesn’t really cover the 2K games all that much? Because 2K doesn’t send him on free trips. No matter how much pasta claims to be un-biased he is. Just play the game yourself and come up with your own opinion on the game
November 30, 2007 at 5:43 pm
So is pasta is bias than why are you guys even on here? If you dont respect his opinion and think that is bised than go on another site. Maybe he actually prefers the Live game then the 2K game. Did you ever think about that? Just because he goes to media days with EA doesnt mean he is biased. And if he is, then go on to 2Ksports site and hang out there. Oh and I did play Live and 2K8. I feel Live is a better overall game. To many things hampered me from enjoying 2k. Players gaurding the same man is something that is just bad. Thats my opinion. And yea, I didnt go to any EA media days thats just my opinion. Everyone has one.
November 30, 2007 at 6:44 pm
wow…
gamespot takes cash from edios & then fires a reviewer for a bad review…im stunned…maybe eidos should make a better game…but why do that when you can spend millions on ads…
how it goes ” buyer beware”…
& to the guy that says this is a EA fanboy site…
your right… by thinking LIVE is anywhere as good 2k8BB your high…but to each his own brother…go back to playing NFL STREET or FIFA backyard or NBA BALLERS…or whatever lame spinoff EA shoves down OUR throats…
the internet is full of PR hacks,liars & sheep
GO GSW
November 30, 2007 at 7:41 pm
Pastapadre is a man of the people. I believe what he says because it is common knowledge that he meditates and does yoga. All people who meditate and do yoga are honest and trustworthy, especially Pastapadre.
When I’m coming up to an intersection in my car and the light is yellow, sometimes I’m not sure whether I should speed up or try and stop. I think to myself “what would Pastapadre do?” Knowing that Pastapadre is honest, hardworking, and as American as apple pie, I decide to stop the car and wait for the light to turn green.
Pastapadre saved my life. Maybe some day he’ll save yours…
November 30, 2007 at 8:04 pm
[quote comment="6889"]wow…
gamespot takes cash from edios & then fires a reviewer for a bad review…im stunned…maybe eidos should make a better game…but why do that when you can spend millions on ads…
how it goes ” buyer beware”…
& to the guy that says this is a EA fanboy site…
your right… by thinking LIVE is anywhere as good 2k8BB your high…but to each his own brother…go back to playing NFL STREET or FIFA backyard or NBA BALLERS…or whatever lame spinoff EA shoves down OUR throats…
the internet is full of PR hacks,liars & sheep
GO GSW[/quote]
I was with you until that NFL Steet FIFA comment. Those games are horrible. I for one think they are geared more to kids. Im not a kid I dont play that crap. Its just ashame that we are on one mans site and we have people that dont respect what he does. Some people just want to complain about anything just to make them selves feel better.
November 30, 2007 at 9:08 pm
Zuka Patingen that is freaking hilarious!!!
November 30, 2007 at 9:33 pm
Giving that game a 6 was being really nice of him, that game is awful.
November 30, 2007 at 9:42 pm
lol @ fanboys…i can’t believe fanboys have the power to get people fired now lmao
December 1, 2007 at 10:56 am
Great write up Pasta and its amazing to me how the old and tired EA vs 2k debate still comes up. Why can’t some of these people let others enjoy whatever game they enjoy. BTW I have NBA 2k8 and im ready for a trade in myself.
December 1, 2007 at 11:07 am
THIS STORY IS BIGGER THAN THIS WEBSITE FOR YEARS IGN HYPES U GAMES GETTING U ALL GEEKED TO BUY THEM, THEN ONCE THE GAME COMES OUT THEY GIVE IT A CRAPPY RATING. IVE ALWAYS WONDERD ESP WITH THE MADDEN THE PREVIEW IS SO GOOD THEN THE REVIEW IS SO DIFFRENT AND WE ALL KNOW IGN IS BIAS TOWARDS 2K SPORTS FOR ONE REASON OR ANOTHER! I THINK PASTA DOES A GOOD JOB OF GIVING HIS OPINION AND HIS TAKES ON WHAT HE SEES FROM PLAYING THE GAME. LIVE WAS OK BUT COULD BE BETTER FASTBREAKS, REBOUNDING, AND BETTER ANIMATIONS I WONT EVEN SPEAK ON MARCH MADNESS BUT EVEN 2K DOESNT EVEN CAPTURE THE REAL COLLEGE EXP. I SAY READ REVEIEWS BUT THEN RENT AND PLAY AND DECIDE FOR YOURSELF SURE YOULL SPEND A FEW MORE DOLLARS BUT ITS WORTH IT. VIDEO GAMES ARE BIG BUISNESS SO SOME PEOPLE MIGHT BE GETTING PAID TO LEAN ONE WAY OR ANOTHER THTS WHY THERE ARE SITES LIKE THIS ONE THT KEEPS IT REAL! PERSONALLY I THINK THE SYSTEMS ARE COMING TO FAST AND THE DEVELOPERS CANT KEEP UP MEANING WE HAVE THESE SYSTEMS THT CAN SUPPOSEDLY DO SO MUCH BUT THE GAMES ARE LIKE LAST GEN WE WILL PROB SEE A GREAT MADDEN FOR PS3 WHEN PS4 IS ANNOUNCED. AND THTS REAL!
December 2, 2007 at 6:34 pm
i agree with all that you said. thanks for just giving all your honest opinions on things its refreshing
December 3, 2007 at 6:55 am
in my opinion the best solutions are blogs like this one. No scoring system juts good old fashion information and community involvement. If all of those site got pulled today it wouldn’t be to soon.
December 3, 2007 at 8:28 am
Im agreeing w/ Art, point systems are bias… Cats just have to put in there 2 cents and leave it alone. I like this site (I check it once or twice a week) for update on games… In no way can a man behind a computer tell me that a game is good or bad… For cats saying silly shit like so and so is a man of the people, then turn around and call people “fanboys” is silly… You are a fanboy in your own way and you need to judge games for yourself, no someone who is obviously on a payroll or gets perks for giving games nice taylor made reviews… a good game is a good game…
Yeah I said it again…
Shoe
December 3, 2007 at 11:22 am
I’ve ajusted my roster on numerous occasions via the roster management; however, whenever I go online to play, the computer prompts me to download the updated roster provided by EA. Is there a way to use the roster online that I revised via “roster management?” Also, the same thing occurs when I adjust my depth chart prior to going on line (the system tells me that I must download the updated roster). Can I adjust my depth chart prior to online play?
December 3, 2007 at 12:55 pm
By the way, after playing a little of Kane and Lynch, I can say that the review written on GameSpot was pretty accurate. It’s a fun enough game, when it works. The hit detection is awful, and the cover system needed some more attention. But, when the game works, it’s frantic and a fun play. Maybe Eidos can correct some things with a patch for DC?