Post edited 6:49 am – November 18, 2009 by Drew
Darkride66(Kyle?),
First off, I’d like to apologize for the slandering of your name on our forum. Naturally, this isn’t something we advocate, but as I’m sure you can appreciate, it’s difficult to moderate all user-generated content in an area such as a webforum. Thank you for doing your part to make the Lens of Truth forums a more constructive place for game analysis by pointing it out.
I have to admit though, I was a little curious after reading evildeli’s post. Who would have a problem with us? We’re an independently funded website run by a group of guys who just love to play video games. We all work in the business and have extensive experience not only playing games, but making them too. Seriously, we live for it. But as I’m sure most people can agree with; it’s so damn expensive! Really? $60 a game? Who has the kind of money to spend that on all these games without some kind of guide to go on? It gets even harder when you have multi-platform games. Surely they have to be different in SOME way. So as I’m sure you’ve read all over our site, we try our hardest to answer the seemingly prevalent question that motivates most of us as gamers: "Which of these is worth my sixty bucks?" This has been the main focus for the site since it’s inception on a crappy Celeron server in Shawn’s living room almost a year ago.
So I did some digging.
Evildeli referenced n4g, so I went straight there and created an account (I know, I’m embarrassed. I read stuff on there all the time, I just never took the time to make an account). I searched for our articles and cross-referenced them with comments listed in your profile. Did you know that you posted an average of 3.36 comments per article of ours dating back to September 23? That's across 11 articles. I read every one of them. However, after having read all of them, I can honestly say that you definitely disagree with pretty much everything we’ve ever presented on the site. Additionally, you even went on to write a few articles about us on your website, which at first I thought was kinda cool. After further review though, I realized that not only do both articles say pretty much the same thing, but that they’re both (very) thinly disguised attempts to discredit what sites like Lens of Truth and Eurogamer do. You even use the release of MW2 to springboard your campaign against comparison sites by rewriting your first article to more "appropriately" voice your disapproval of our site. They’re well-written though, and they have an academic/journalistic style to them that I can appreciate, if not agree with.
So you said:
What a ridiculous claim. No where have I have stated I have a problem with LOT. I don't. They're just another gaming site trying to make it with their own angle and I wish them the best of luck.
and
No where have I ever said LOT falsified data, or claimed something that wasn't true
After rereading some of your comments on n4g, I have to call you on these, darkride66. I think anyone can read your comments and come to the same conclusion.
As per our Tekken 6 analysis article:
My real beef is with those who labor under the false assumption that LOT's conclusions are beyond reproach.
And our MW2 article:
The problem with sites like LOT is there's usually no way of checking if they're accurate or not.
Or your disagreements with our earlier conclusions (BlazBlue, Wolfenstein, etc), which you manage to comment about in almost all of our articles. Or your accusations that we break street date. Or your articles that basically say comparison websites are worthless.
But here, I think, are your real problems with the website:
1) Some people use the Lens of Truth website (and Eurogamer website) as a tool to make an informative decision as to which multi-platform game to buy.
2) You can’t double-check our work.
3) You disagree with a lot of our conclusions.
First, I’d like to point you to our FAQ page. On it, you’ll find a flowchart that describes exactly how we do our capturing and with what hardware. I’m not sure what your expertise with A/V setups or HDMI capture devices is, but I will say some members on our staff are Subject Matter Experts in this area, and that our captures are unmodified and directly from the source. As far as settings, games are almost always compared "out of box" (hence the flack we got for the MW2 article). That means that we do what’s necessary to get the game running on the console, and then we analyze it. If no install is required – we don’t install. If color matching isn’t required – we don’t match colors. For loading , we use a stopwatch to record a series of times to try to spot anomalies. For performance, we’ve developed software that analyzes uncompressed video and counts unique and torn frames from a series of clips. This can be done manually by frame-stepping through uncompressed captured video. Tedious, but possible.
Next, I’d like to address the format of our articles. Naturally this has been a work in progress, as I’m sure you’ve noticed since our earlier articles that you disagree with. The site is constantly changing. We’ve changed scoring schemes, changed scoring criteria, gotten some new hardware, added in a frame analyzer, and numerous other behind-the-scenes changes. Is it fair to bring up our earliest conclusions as a reason why users shouldn’t value our work now? Further, as much as you declare that our conclusions shouldn’t be trusted, who would make better conclusions based on the data that we’ve gathered? Disagreement is going to happen. We include all the data in our articles for users like yourself who don’t want to put their faith in a website’s opinion. If you disagree with the conclusion, read the article and make up your own. If you disagree with the data, feel free to refute it (or back it up). You know how to do it, and so does everyone else. I'm not sure sites like IGN or metacritic can say that.
Lastly, I'd like to point to our "Contact Us" form. Like I already said, the site is constantly changing. You don’t agree with something about the way the site reviews games. I get that. What don’t you agree with? What would you like to see changed on the site? Don’t you think that your criticisms would be better voiced (and heard) through a proper avenue like our "Contact Us", and not through 3rd party websites or our user forums?
Carpet chewing crazy,
-Drew