Rebas Kradd, on 25 March 2014 - 02:58 PM, said:
I'm a math teacher, so don't talk down to me about statistics. You are making massive assumptions here. You don't actually have even the slightest knowledge of how they gather telemetry. And while I don't need to believe PGI is perfect, whenever you accuse someone of lacking basic high school math from such a position of unawareness as you stand on...well. Such easy and cartoonish assumptions don't stand well with me. You're a person talking about another person, not about the handy idiot that our minds tend to create when we think across the internet gap.
Let's work this out logically.
a) The "patch testing" period is not set at six days. A lot of people noticed the LRM flood tapering off after 2 or 3.

If LRMs were overbuffed, then it would stand to reason that their high usage WOULD REMAIN after the first week of the patch, so Paul would be waiting for a tapering-off that would never come.
c) Tournament time is not necessarily a guarantee that LRMs will rule. I recognize a number of the faction winners as PPC/AC meta-numbskulls.
d) Not every match features high LRM usage. I've played plenty that were pretty quiet on that front, and some that weren't. There are a number of matches that, with a little (gasp) selective observation, could be used for reliable analysis. You're just conveniently assuming that PGI didn't think of that.
e) By the way, matches that are flooded with LRMs still have their own informative value.
f) Part of the announced upcoming changes, screen shake reduction, is hardly a statistical thing and relies mostly on observation.
g) The announced change has been relatively small. It's not like they're undoing the patch. Your reaction is out of proportion to the situation.
let's clarify a couple of things
Math =/= to statistician
Math =/= ESPECIALLY social statistician
balance = math
decisions on how to balance =/= math (in a simplistic form that we're talking about)
I DO have knowledge of how they collected telemetry because they TOLD US how they did it. Paul posted it.
6 days
a very small sample size of matches reviewed (these are NOT assumptions, these are directly stated by the person collecting the data)
Data reviewed while in an upward trend right after the release of a new buff (in other words they should have waited and reviewed data in a much more "stable" example)
that's NOT a good, solid, and reliable way to collect data,period.
if you're trying to support that junk as quality statistical data collection then you're quite simply wrong. period
basing any kind of decision on junk science like that is going to cause the decision is going to be skewed. period
There are no assumptions there. period
I NEVER accused them of lacking basic high school math. I accused them of NOT using good science in collecting their data. I accused them of using piss poor data collection, sampling, and making in turn, a piss poor decision based on piss poor data. I accused them of basing decisions on junk. I accused them of making a decision based on statistical data that would be laughed out of ANY statistical forum. period
A) PAUL STATED he watched for 6 days. Take it up with him

Whish is why you DO wait to see if they DO taper off. That's called good data collection as opposed to bias
C) Tournament means there were a LOT more and different playstyles outside of the norm. The norm is what you want to collect data on. Not outliers, special instances, etc. Again, this kind of stuff is stats 101, not math 101
D) Again, I'm not assuming anything, I'm basing this DIRECTLY from Paul's statement. Although you're pointing out yet again WHY his statements on how he collected the data is bad.
E) yes they, as does every other match played, as opposed to a small sample size watched by one person over a few days...
again, not assumption, EXACTLY what Paul stated and EXACTLY why you dont' collect data like that
F) Observation was done to collect statistical data. That's EXACTLY what it is. They were observing to collect data to make a decision. You're absolutely right though, it wasn't statistical data, it was a casual observation which is exactly why it's wrong
G) That's a matter of opinion and I don't think it is. If it were an isolated incident I might be more inclined to agree.
Edited by Sandpit, 25 March 2014 - 05:30 PM.