Jump to content

Public Mech Rating 2017 ---- Full Results!


69 replies to this topic

#1 Tarogato

    Member

  • PipPipPipPipPipPipPipPipPipPip
  • Civil Servant
  • Civil Servant
  • 6,558 posts
  • LocationUSA

Posted 14 July 2017 - 01:42 AM

It's been about a year since the last time I did this. You can see last year's results here. A lot has changed since then, we've had the energy rebalance, some mild quirk adjustments, the engine desync and various other significant effects of the new skill tree. So let's run a pre-Civil War survey before everything changes again!


Survey ended, here's the results!

Thank you everybody who filled out the survey, all exactly 400 of you! That's nearly 100 more responses than last time, a pleasant surprise.

I'll probably do this again some time around January 2018 or so, after Escalation mechs have had time to settle into the game. Then we can compare pre-civil-war to post-civil-war.




> Simple results, the averages

Lights: The Arctic Cheetah was voted the top light at this time, with an 8.0 average vote. The WLF, LCT, JVN, and JR7-IIC all came in around 7.0, and the remainder of the lights fall "below average". Although the WLF tied for second best light, there was a lot of disagreement over its placement, only the Commando had a higher standard deviation. The Mist Lynx was voted the worst light by far with a 3.3 average.

Mediums: The Hunchback IIC reigns supreme with a 8.7 average vote, with the HMN and NVA at its heels. People agreed very strongly that those were the top three mechs. The SCR, GRF, and BSW all rest "above average". The VND and KTO were voted the worst mediums, but the TBT, IFR, and PXH all fell below the average.

Heavies: The Night Gyr sits at the top with an 8.9, but it doesn't win by a large margin. The EBJ is strongly agreed upon with an 8.1, and after that it's a bit of a wash between the WHM, HBR, and TBR, and then a load more closely packed together. Falling below average were the DRG, QKD, RFL, ARC, and ON1, with the CTF being voted the worst heavy. People strongly disagreed over the DRG, however, more than any other heavy. I guess that's what happens when you have a chassis that's largely terrible but has one niche build that works quite well (DRG-1C with 3LPL or 3ERLL)

Assaults: Sweeping the top spot is the Marauder IIC with a 9.1 average vote. The KDK came second with an 8.2 and the BLR not far behind. Above average were the MAL, SNV, then CP and WHK. Of the five lowest averaging mechs, the HGN is the most agreed upon with a 4.1, and while the AWS had the lowest average (4.0), votes on it were all over the place. The GAR, VTR, and ZEU make up the other three that settled at the bottom.


> Boxplot version, more detailed information
Google Sheets doesn't support boxplots... so I had to make my own. Hey, don't judge, it works!









Breakdowns!


Posted Image


> Clan vs Innersphere

Surprisingly, nothing really stands out! Clan and IS loyalists appear to agree on just about everything. It's actually the apparently "neutral" party that really seems to diverge here and there on certain mechs. Very curious indeed.


> Casual vs Competitive

This is where we finally see some very interesting results. The casual crowd and competitive crowd disagree quite a bit on some mechs, and the "in the middle" group conveniently often sits... in the middle! It's a little too consistent to be just noise in the data. More often than not, the competitive crowd see more value in a mech than the casual folk. Examples include the FS9, WLF, HBK-IIC, DRG, NTG, GAR, SNV. It's a bit less often that the casual peeps vote a chassis higher than everybody else. Examples of that include the BJ, JM6, WHM, ZEU, KDK. Intriguing choices... most of those can run ballistics. Is it that casual players love their dakkadakkadakka with less regard for how effective it is? Mayhaps, but just a guess.







> Split up by Match Score

This is kinda where it mattered if you put in your actual MWO name.
While I appreciate the effort from --PooShooter--, Puѕѕy Crusher, How About No, noneofyourfuсkingbussiness, and taragatosmokesatonofpeniѕ... unfortunately I couldn't find any of your names on the leaderboard. Posted Image


Here is chart showing the distribution of players that partook in the survey:

Posted Image
The global average matchscore is somewhere around 210, so I used that as a cutoff, and arbitrarily decided to also separate players who average above 320 match score. Those in between, ranging from 210 to 320 matchscore inclusive, while considered above the game's global average, made up the majority of my respondents.









> Solo vs Group vs FP vs Comp

I was hoping to see some differences here, but all the groups voted pretty much the same. Disappointing. The only thing that stands out to me is that the comp/private lobby group thinks more highly of the WLF and FS9, and doesn't value the RVN and CN9 as much. Other than that... only subtle fluctuations, indistinguishable from noise. I'd like to analyse the overlap between groups here, but I'm really not sure how to approach that, so... yeah.


> Last year vs This year

Lights: The Commando soared! While it's still only considered about an average light mech, it saw a big jump from 2.7 to 5.8. The Skill Tree had a big part in this, because the Commando is now about 30% tankier. It was probably underrated before, being a slippery little bugger that's notoriously hard to kill, but the new durability gave people the balls to hop in and wreck havoc with the little man. Aside from the Commando... the Wolfhound also gained a lot of ground compared to last year. Did it even get any buffs? I suspect that it's less about buffs and changes and more about people just finally realising the potential of the thing - with so many other lights receiving nerfs, not many bothered to give the WLF a fair shake before because it was always third fiddle. (does that make it a viola?) The Arctic Cheetah went down by wee bit, but it's still on top. It's hard to beat a 30-tonner scaled light mech that goes 130+ kph and has Clan XL with 5+ energy hardpoints.

Mediums: Not a lot changed. The HMN has come into proper vogue, the BSW turned out a lot better than people expected it to last year, the PXH got a few buffs, and the SCR got hit a little by the engine desync.

Heavies: The TBR dropped by a bit and as a consequence people voted the EBJ a tiny bit higher. Interesting to note that the TBR was strongly agreed to be best heavy before, but now people don't agree as much - some think it hasn't dropped much at all, while some do. The ON1-IIC got durability buffs and is more valued now, the LBK turned out a lot better than people expected, and we found a hidden gem in the DRG, which rose noticeably and is no longer considered the worst heavy.

Assaults: Most people underrated the MAD-IIC in last years survey, as it hadn't been released yet. Since then, gauss got a huge explosion chance nerf, and the engine desync hit - both of these dragged the Kodiak down by a ... little bit. The Skill Tree also introduced Super Double Coolshots and the MAD-IIC took the KDK's place. People seem a lot less sure of the DWF now, but one thing they agreed on is that it sits lower than before. The Victor rose from being the the worst rated assault... to being one of the five worst rated assaults. Wouppee. But as is the theme... people don't agree on it as strongly now as they did before. I really suspect a lot of people are still voting by how mechs used to be as much as 2-3 months ago, without fully being caught up on how they actually are today.

Edited by Tarogato, 17 July 2017 - 03:34 AM.


#2 JadePanther

    Member

  • PipPipPipPipPipPipPip
  • Liquid Metal
  • Liquid Metal
  • 967 posts

Posted 14 July 2017 - 01:45 AM

might wanna postpone or just write this up as a PRE CIVIL WAR... cause the new tech is gonna change alot of things around... some mechs might become quite viable with is ultras, racs, ER's and MRM. some clan mechs could become better with heavy lasers..

#3 Tarogato

    Member

  • PipPipPipPipPipPipPipPipPipPip
  • Civil Servant
  • Civil Servant
  • 6,558 posts
  • LocationUSA

Posted 14 July 2017 - 01:54 AM

View PostJadePanther, on 14 July 2017 - 01:45 AM, said:

might wanna postpone or just write this up as a PRE CIVIL WAR... cause the new tech is gonna change alot of things around... some mechs might become quite viable with is ultras, racs, ER's and MRM. some clan mechs could become better with heavy lasers..

Ermmm, did you read the post? Posted Image

View PostTarogato, on 14 July 2017 - 01:42 AM, said:

So let's run a pre-Civil War survey before everything changes again!


As in, the whole point is to see how people perceive balance before Civil War, so we can compare it to post-Civil War later. I'll probably run another survey after the Escalation mechs have had time to settle in, probably January.

#4 C E Dwyer

    Member

  • PipPipPipPipPipPipPipPipPipPip
  • Legendary Founder
  • Legendary Founder
  • 9,274 posts
  • LocationHiding in the periphery, from Bounty Hunters

Posted 14 July 2017 - 02:03 AM

Taken the survey

A noticed you have the option of taking it again, doesn't that run the risk of the results being spolied, by deliberately throwing in false copies

As an example I could now go and 1 star the MAD II and Kodiak, while 10 staring the Mist Lynx endless times

#5 JadePanther

    Member

  • PipPipPipPipPipPipPip
  • Liquid Metal
  • Liquid Metal
  • 967 posts

Posted 14 July 2017 - 02:07 AM

View PostTarogato, on 14 July 2017 - 01:54 AM, said:

Ermmm, did you read the post? Posted Image



As in, the whole point is to see how people perceive balance before Civil War, so we can compare it to post-Civil War later. I'll probably run another survey after the Escalation mechs have had time to settle in, probably January.


mighta skimmed a lil too fast.. but maybe title better.. people will still try and use this as a baseline even though come civil war it can get thrown out the window completely..

#6 Tarogato

    Member

  • PipPipPipPipPipPipPipPipPipPip
  • Civil Servant
  • Civil Servant
  • 6,558 posts
  • LocationUSA

Posted 14 July 2017 - 02:13 AM

View PostCathy, on 14 July 2017 - 02:03 AM, said:

A noticed you have the option of taking it again, doesn't that run the risk of the results being spolied, by deliberately throwing in false copies

As an example I could now go and 1 star the MAD II and Kodiak, while 10 staring the Mist Lynx endless times


No, I can see every response, and I have multiple diagnostics in place to determine troll submissions, so they are easy to spot and remove.

#7 C E Dwyer

    Member

  • PipPipPipPipPipPipPipPipPipPip
  • Legendary Founder
  • Legendary Founder
  • 9,274 posts
  • LocationHiding in the periphery, from Bounty Hunters

Posted 14 July 2017 - 02:24 AM

View PostTarogato, on 14 July 2017 - 02:13 AM, said:

No, I can see every response, and I have multiple diagnostics in place to determine troll submissions, so they are easy to spot and remove.

Mechcellent !

#8 El Bandito

    Member

  • PipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • Big Daddy
  • Big Daddy
  • 26,736 posts
  • LocationStill doing ungodly amount of damage, but with more accuracy.

Posted 14 July 2017 - 02:35 AM

Submitted mine. And judging from the responses, people seem to underestimate the potency of the Supernova.
If only Boiler, with its PPFLD config was more used.

Edited by El Bandito, 14 July 2017 - 03:03 AM.


#9 Kasumi Sumika

    Member

  • PipPipPipPipPipPipPipPip
  • Shredder
  • Shredder
  • 1,118 posts
  • LocationFeeding the Fires of Rubicon

Posted 14 July 2017 - 02:39 AM

...and done!

#10 C E Dwyer

    Member

  • PipPipPipPipPipPipPipPipPipPip
  • Legendary Founder
  • Legendary Founder
  • 9,274 posts
  • LocationHiding in the periphery, from Bounty Hunters

Posted 14 July 2017 - 04:15 AM

View PostEl Bandito, on 14 July 2017 - 02:35 AM, said:

Submitted mine. And judging from the responses, people seem to underestimate the potency of the Supernova.
If only Boiler, with its PPFLD config was more used.


Maybe, but it''s one of the few mechs I don't own in some form, so I can only score it, as I see it, and I see most as sitting ducks shut down or LRM boats.

I feel the same goes for the Highlander, it was first replaced by the Victor and then disappeared virtually from the game, because it's hit boxes are so bad, and I think it's getting scored based on how people remember it.

I took mine out for a spin, after seeing Baradur's games with the Heavy Metal on you tube. No way is it ever going to see comp play, but the armour buffs make it a solid mech choice for solo and group queue.

If I get my backside in the game long enough I'm thinking of building a CW deck around it, just as an experiment, with it's current armour quirks that thing can tank.

#11 Wil McCullough

    Member

  • PipPipPipPipPipPipPipPip
  • The 1 Percent
  • The 1 Percent
  • 1,482 posts

Posted 14 July 2017 - 04:24 AM

linebacker rating that low?
goood gooooooood.

LINEBACKER IS FINE PGI. NOTHING TO SEE HERE. SHOO.

#12 Skanderborg

    Member

  • PipPipPipPipPipPip
  • Liquid Metal
  • 411 posts

Posted 14 July 2017 - 04:39 AM

Put my 2 cents in , surprised the commando and myst lynx have their score. Having piloted both for some time they're fun but extremely ineffective.

#13 El Bandito

    Member

  • PipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • Big Daddy
  • Big Daddy
  • 26,736 posts
  • LocationStill doing ungodly amount of damage, but with more accuracy.

Posted 14 July 2017 - 05:21 AM

View PostTarogato, on 14 July 2017 - 01:42 AM, said:

It's been about a year since the last time I did this. You can see last year's results here.


Oh yeah, allow me the chance to laugh at those guys who had rated the MAD-IIC so low, in the last year's survey. Even without having the chassis in game I knew right away right then just how potent that mech was gonna be.
I gave the MAD-IIC nine points back then. And guess what? It is sitting at 9.1 right now, with very little deviation. Posted Image


Posted Image

Edited by El Bandito, 14 July 2017 - 06:06 AM.


#14 LORD ORION

    Member

  • PipPipPipPipPipPipPipPip
  • Heavy Lifter
  • Heavy Lifter
  • 1,070 posts

Posted 14 July 2017 - 05:47 AM

View PostWil McCullough, on 14 July 2017 - 04:24 AM, said:

linebacker rating that low?
goood gooooooood.

LINEBACKER IS FINE PGI. NOTHING TO SEE HERE. SHOO.


Linebacker is one of those exponential outliers.

1 line backer is kinda derpy
12 is BS
3 waves of kamikazi linebackers is nearly impossible to deal with in FP.

#15 El Bandito

    Member

  • PipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • Big Daddy
  • Big Daddy
  • 26,736 posts
  • LocationStill doing ungodly amount of damage, but with more accuracy.

Posted 14 July 2017 - 06:06 AM

View PostLORD ORION, on 14 July 2017 - 05:47 AM, said:

Linebacker is one of those exponential outliers.

1 line backer is kinda derpy
12 is BS
3 waves of kamikazi linebackers is nearly impossible to deal with in FP.


Leg them for easy-mode. They mostly have 270 range weapons so once legged, they are as harmless as rabbits. We use legging against KCom's Linebacker rush to good effect.

#16 Wil McCullough

    Member

  • PipPipPipPipPipPipPipPip
  • The 1 Percent
  • The 1 Percent
  • 1,482 posts

Posted 14 July 2017 - 06:35 AM

View PostLORD ORION, on 14 July 2017 - 05:47 AM, said:


Linebacker is one of those exponential outliers.

1 line backer is kinda derpy
12 is BS
3 waves of kamikazi linebackers is nearly impossible to deal with in FP.


12 is kinda meh because they're not very durable and can't stand up in a prolonged fight.

2-3 linebackers though? goddamn menace.

they move around quickly enough and with enough firepower to snowball small skirmishes into rofl stomps.

#17 Kanil

    Member

  • PipPipPipPipPipPipPipPip
  • 1,068 posts

Posted 14 July 2017 - 07:15 AM

"If you don't own the mech, you've probably seen it in action and have an idea how to rate it anyway."

This makes me realize how many 'mechs I just don't see that often. Javelins and Roughnecks aren't out for C-Bills, but there's still a lot of vanishingly rare 'mechs.

#18 PhoenixFire55

    Member

  • PipPipPipPipPipPipPipPipPipPip
  • Legendary Founder
  • Legendary Founder
  • 5,725 posts
  • LocationSt.Petersburg / Outreach

Posted 14 July 2017 - 07:36 AM

IMO such voting method is incorrect. When one variant of the chassis significantly outperforms the rest for example. It reminds me of PGI balancing the KDK-3 by shafting all KDKs into useless.

#19 RestosIII

    Member

  • PipPipPipPipPipPipPipPipPipPip
  • The 1 Percent
  • The 1 Percent
  • 7,322 posts
  • LocationDelios

Posted 14 July 2017 - 08:33 AM

'fills it out'

Posted Image

#20 Metus regem

    Member

  • PipPipPipPipPipPipPipPipPipPipPip
  • The Sureshot
  • The Sureshot
  • 10,282 posts
  • LocationNAIS College of Military Science OCS courses

Posted 14 July 2017 - 08:47 AM

Posted Image

And done.





1 user(s) are reading this topic

0 members, 1 guests, 0 anonymous users