Be Rough With Me Plz, on 08 August 2014 - 08:09 AM, said:
If the majority of the matches being played happen in the Solo Queue, then the way PGI implemented their tests is accurate because it captured the randomness from PUG matches. If you were to hold a test in a controlled environment, not simulating actual conditions of how the majority of the game is actually being played then you would have sampling bias.
...
That's bad logic for a video game. I'm going to say this, as a PuGGer, PUG matches don't matter, especially for testing.
If my mom can get an account today, at play 3pm and influence the study... that's not the metric we want. The PUG playerbase is so wild, so crazy, so full of "lets try this" or "I want to try this new trial mech" or "Daddy let me drive!" or "Where's the rest of my elite group? Ah well, lets pug till they get on" that it makes NO sense to balance around those people play abilities. Am I pugging? Hell yeah! Is my son on my lap? Hell Yeah! Is my 9 year old? Hell yeah! Don't test us for weapon viability though, jesus.
Only in the "I've invested so much energy to MWO that I even joined a team" environment is it even remotely possible to BEGIN to test for things like Weapon and chassis ability.
I'm not disputing the results, they are probably accurate. The test itself is dumb.