Tesunie, on 19 May 2017 - 11:54 AM, said:
Sorry for late reply. Life got busy and I knew this would probably take some time (though I will try to be short).
Here is the crux of my problem, a lot of people display their opinion of LRMs as "facts". I see it all over the forums where they pop into LRM threads and bash that LRMs aren't good and don't take them (instead of often times just answering the person's questions about LRMs, maybe with a discouragement attached). They plaster their "opinion" as pure fact, back it up with their own stats/screens/videos of them killing an LRM boat or videos/examples of "comp teams" and if anyone seems to counter their approach (be it with general statements or by pointing out that not everyone is playing in those high tier competitive situations) get called out to "prove it". Then, like in this thread, get called out on not providing evidence "sufficient" to prove anything.
No one has the data to claim that bringing LRM's will decrease the likelihood of winning a match. What they can point out and what we do have access to is that competitive teams in the various leagues don't bring LRM's. That's a statement that can be verified because most of those leagues require the teams to submit recordings of their matches.
Whether or not that fact sways your opinion or not is up to you. As to all the rest, yes you can point out that they don't have any actual properly analyzed data to support their hypothesis either. However, I don't recall ever seeing someone claim to have done "scientific analysis" that supports that position.
Quote
In this particular case, the "fact" was that "taking any amount of LRMs on your mech decreases your chances of winning". I may have jumped the gun a little, but I already assumed I was going to be called out to provide evidence to my claim. In this situation, I actually had statistical data over the years I've played MW:O that actually seemed in direct contradiction of that claim. This isn't to say these will be everyone's "average" results, but merely a showing that "it is possible" to get a good W/L rate even with LRMs on your mech, depending upon how you use them.
That's exactly why the claim "bringing LRM's CAN decrease your chances of winning a match" is a useless hypothesis to test. It takes only a single isolated instance to be verified. The proper claim that you and the others want to test is the claim "bringing LRM's WILL decrease your chances of winning a match." A single isolated case is insufficient to refute the claim. A proper refutation requires much more robust, unbiased, data set to answer.
Quote
If anything, I think it was the other side that was saying "all shoes are red", but in this case it's because "all comp teams wear red shoes" (replace shoes with effectiveness of direct fire weapons).
Given our lack of a proper data set for analysis, the consensus opinion of generally acknowledged experts is for many sufficient argument to accept the "LRM's are bad" hypothesis. If you think the experts are mistaken or are not really experts you are free to stay with your counter hypothesis. There's no statistical evidence to back either position.
Could those experts be wrong? Sure. Are those experts wrong? We can't know right now.
Quote
I'm the one walking in here and showing that there are actually other color of shoes as well, such as my green shoes (insert my LRM statistics instead of shoes).
There's a difference between claiming that "bringing LRM's eliminates your chances of winning a match" and "bringing LRM's will decrease your chances of winning a match." Your single counter example can refute the first claim but is insufficient to do the same to the second claim.
Quote
Meanwhile, I continue to be told that all shoes are red, and that my green shoes are irrelevant because I'm not one of a specific set of people, or not the majority, or not a comp player, or...
You might be right. Might be.
Quote
I'm only showing my set of statistical data, and coming to conclusions that they show me. As we've already determined that we can't see anyone else's data, we kinda need to come to our own opinions/conclusions. I don't exactly need a precise scientific method to read my own stats and determine that I can use some builds better than others, and to determine what may make those specific builds better in my hands than other builds might.
Where's your control for comparison? Where are all of the results of the exact same matches you dropped in with LRM's but without the LRM's? If you don't have those (you can't possibly have those), then you can't actually refute the claim that bringing LRM's DECREASED your chances of winning because you don't know what your win rate would have been without them.
That's why we need a larger data set than just one pilot's experience. With a large data set, proper controls can be established to account for other factors that might affect win rates like maps, tiers, time of day, solo v. group, quick v. faction play, etc . . .
A proper ANOVA (analysis of variance) would be able to give you a mathematical value telling you exactly how much LRM use affects the win rates of matches and whether that affect is significant, positive or negative. No data. No ANOVA. No answer.
Quote
I'm going for personal effectiveness here, accounting for the individual to make up their own mind on what does and does not work for themselves. One such way to do this would be to test it. Play with the weapon/build in question and see how well you individually handle it.
Biased data collection. Humans are incredibly bad at being unbiased in the manner you described. You will go into your "test" with an opinion about what the results will show. That will bias the way you play without you even being consciously aware of it. Seriously, scientists have done many studies showing that confirmation and observation bias are real things. That's why science uses specific protocols. The human biases have to be eliminated as much as possible if you want to discover what is "really" going on.
Quote
But at the same time, I'm not trying to discredit "the meta" nor "what the comp teams play". But lets face it, the most meta of meta mechs isn't always going to work for everyone...
Meta in most games are just aggregated opinions of players. It's subject to the same biases as individual opinion and even subject to a few more. Just look at the various phases that the NFL has gone through in regards to various offensive and defensive systems even though the basic rules of the game have rarely been altered in any way. It's fashion for people who think that they are not slaves to fashion.
Quote
I would like to mention, you've fallen into the trap many people do with LRMs, and referred to boats. I have long since believed that boating LRMs do a lot to enhance their weaknesses far more than it does their strength (though they can work and I'm not knocking them). I'm also not the one here trying to make a case saying that LRMs are awesome, I merely was trying to point out that LRMs can work effectively, giving the correct skill set and intended use within a build/team. Rather that is only I can do it (I know I'm not), or rather everyone is able to do it wasn't really my argument here.
Doesn't matter whether we are talking about boats or mixed builds. We don't have the appropriate data to answer the question in either case.
Quote
Though I agree I would need a far larger sampling than just my statistical data to say that LRMs are comparable to other weapons (which I will note, isn't my intention here at all), I don't need a mountain of data to show that LRMs can be useful depending upon how you personally use them. See, here is the difference, I'm talking about individual results, not your average player results.
Then you aren't actually addressing most of the claims of your opponents in this discussion. They are for the most part claiming that bringing LRM's decreases your chances of winning. Your single counter example can't possibly refute their claim.
Quote
The debate on how effective LRMs are is something that will continue to go on. As you stated, there is not enough evidence to support one statement conclusively. Even then, as I've shown (which was all my intent here was) there are some players who can use them effectively (as I'm certain I am not alone here). We may be in the minority of LRM users, but we are here. I don't believe I really need a large pool of player data to determine that much, and as I stated, my own data was collected over hundreds of matches over months of playing. I also don't use strictly LRMs and actually do use direct fire weapons more than I do LRMs (meaning I should be more practiced with direct fire over LRM use).
If you aren't interested in refuting your opponent's actual claim then you are guilty of engaging in using a straw man fallacy.
Quote
However, if the term/debate is over boating LRMs, than my data would be completely irrelevant, as I don't boat LRMs.
Overall though, I haven't seen anyone else (besides myself) try and post any data up here (besides a few videos or screenshots in comparison to the potential of data provided over hundreds of matches averaged out). We could start to actively collect data, instead of dismissing it all as "inconsequential". (This also assumes that people are in the habit of running builds on mechs unchanged for hundreds of matches, or have ways to separate their data.) I do think it would be interesting to see, just for fun more than to actually try and make any specific points.
Telling people to collect their data and having them know why you want it immediately introduces bias to the data being collected. Seriously, you should look at the lengths psychologists have to go to hide the true intent of their studies from the subjects of their experiments. With humans being such a social species, knowing you are being analyzed and knowing why you are being analyzed significantly alters your behavior. It's an unavoidable aspect of studying humans.
Quote
Anyway. I just wanted to make sure that I'm saying what I want to say here. So, short version, I'm more talking about an individual's performance more than the average player's performance. Thus why I was against the broad stroke statement against LRMs. In the average capacity for players, it may very well be true. But it can't be taken as an absolute either as there are some of us odd-balls out there that can stand in direct contradiction to the statement. (I hope this makes sense?)
It makes perfect sense. It's also irrelevant to what most of your perceived opponents are saying.
Edited by vandalhooch, 19 May 2017 - 06:55 PM.