NET Rankings are Flawed

NorthCyd

Well-Known Member
SuperFanatic
SuperFanatic T2
Aug 22, 2011
21,263
36,041
113
I think we’d have jumped the same spot in RPI with a 5 point win is my point.

I said it’s not perfect but it’s less about style points. Style points make sense for gamblers, not evaluating resumes.
I don't think it was the margin of victory as much as it was scoring 75 against OU. Our offensive efficiency is bad so a performance like that really gives it a boost. I think if we had won 75 - 70 we still would have seen a similar boost.
 

HFCS

Well-Known Member
Aug 13, 2010
75,976
66,476
113
LA LA Land
I don't think it was the margin of victory as much as it was scoring 75 against OU. Our offensive efficiency is bad so a performance like that really gives it a boost. I think if we had won 75 - 70 we still would have seen a similar boost.

same thing though, for a resume a 65-60 win shouldn’t be worse than a 75-70 win. It’s not gambling.
 
  • Agree
Reactions: cyclones500

NorthCyd

Well-Known Member
SuperFanatic
SuperFanatic T2
Aug 22, 2011
21,263
36,041
113
same thing though, for a resume a 65-60 win shouldn’t be worse than a 75-70 win. It’s not gambling.
That's fine. I'm just pointing out that NET doesn’t use margin of victory any more. I disagree that wins vs SOS is all that matters. There are many other performance metrics that should be considered in a power ranking. The people who follow this most closely, bettors and handicappers, have known this for decades. The RPI flat out sucks. If you want to argue otherwise that's fine, but you aren't going to convince me.
 

HFCS

Well-Known Member
Aug 13, 2010
75,976
66,476
113
LA LA Land
That's fine. I'm just pointing out that NET doesn’t use margin of victory any more. I disagree that wins vs SOS is all that matters. There are many other performance metrics that should be considered in a power ranking. The people who follow this most closely, bettors and handicappers, have known this for decades. The RPI flat out sucks. If you want to argue otherwise that's fine, but you aren't going to convince me.

i think it makes all kinds of sense for betting and coaches and prognosticators.

it makes no sense for evaluating a resume of games that have already occurred. Especially with how stupid different these games are officiated in different conferences and regions and the different styles of play that results in.

I never said the RPI was perfect or without flaw but it’s interesting that’s what people wanted to read.
 

NorthCyd

Well-Known Member
SuperFanatic
SuperFanatic T2
Aug 22, 2011
21,263
36,041
113
I never said the RPI was perfect or without flaw but it’s interesting that’s what people wanted to read.
Did I say you thought it was perfect? I must have missed that. I think it's interesting that's how you want to read my comments.
 

cyclones500

Well-Known Member
Jan 29, 2010
38,888
26,936
113
Michigan
basslakebeacon.com
it makes no sense for evaluating a resume of games that have already occurred.

I think this is the key to what you're saying - performance metric is helpful in early part of season to evaluate with a low set of data and establishing some kind of general ranking -- then it should become less of a factor the more "connection" there is among teams and 20-plus games ... going from early speculation to concrete results.
 
  • Agree
Reactions: HFCS

HFCS

Well-Known Member
Aug 13, 2010
75,976
66,476
113
LA LA Land
I think this is the key to what you're saying - performance metric is helpful in early part of season to evaluate with a low set of data and establishing some kind of general ranking -- then it should become less of a factor the more "connection" there is among teams and 20-plus games ... going from early speculation to concrete results.

people fall in love with predictive metrics (to an almost cult like degree at times), but unless I’m mistaken the committee has never been tasked with predicting the future.

Again anyone can correct me if I’m wrong but I thought they were to evaluate and compare resumes of games in the books.
 

Statefan10

Well-Known Member
SuperFanatic
SuperFanatic T2
May 20, 2019
21,198
27,222
113
people fall in love with predictive metrics (to an almost cult like degree at times), but unless I’m mistaken the committee has never been tasked with predicting the future.

Again anyone can correct me if I’m wrong but I thought they were to evaluate and compare resumes of games in the books.
The committee put out their first 16 seeded teams and those chosen teams fall in line with what you’re saying. Houston wasn’t even listed and they’re #4 in the NET.
 

HFCS

Well-Known Member
Aug 13, 2010
75,976
66,476
113
LA LA Land
The committee put out their first 16 seeded teams and those chosen teams fall in line with what you’re saying. Houston wasn’t even listed and they’re #4 in the NET.

Yeah that falls in line with “it’s a tool”. They traded in a flawed tool for a differently flawed tool.

I’m sure part of the reason for focus on quad wins is that they know it offsets the outliers much more than actually focusing on one team’s ranking.
 

BillBrasky4Cy

Well-Known Member
SuperFanatic
SuperFanatic T2
Dec 10, 2013
17,534
31,875
113
That's fine. I'm just pointing out that NET doesn’t use margin of victory any more. I disagree that wins vs SOS is all that matters. There are many other performance metrics that should be considered in a power ranking. The people who follow this most closely, bettors and handicappers, have known this for decades. The RPI flat out sucks. If you want to argue otherwise that's fine, but you aren't going to convince me.

Margin of victory is 100% factored in with the offensive efficiency ratings. I would argue it has more of an impact now than it did two years ago.
 

NorthCyd

Well-Known Member
SuperFanatic
SuperFanatic T2
Aug 22, 2011
21,263
36,041
113
Margin of victory is 100% factored in with the offensive efficiency ratings. I would argue it has more of an impact now than it did two years ago.
How exactly? Offensive efficiency is just points per possession as far as I understand it. I guess it's a little more complicated then that as they then modify that offensive efficiency by your opponents "team value index". Where does margin of victory come into play?
 

QBEagles

Member
SuperFanatic
SuperFanatic T2
Mar 11, 2014
69
59
18
Style points should be meaningless. Wins vs SOS is really all that matters especially how non uniform this sport is across all the teams and leagues.

NCAA selection is about resume, not predicting the score or outcome of one game.

RPI was not perfect but we’re seeing it also wasn’t the worst tool in some ways.

Wins vs SOS is pretty much all Strength of Record is, and I'd be fine if they wanted to seed strictly off a version of that. It's much better than RPI (or NET) at measuring resume. The official selection procedures say they want the "best teams" though, not best resume. I don't really agree with it, but that's where they're adding efficiency to the NET equation.

And while ranking by SoR would by my preferred approach, we'd probably still want two wins from here to be safe. 19-13 probably puts us well into the 40s.
 
  • Agree
Reactions: HFCS

BillBrasky4Cy

Well-Known Member
SuperFanatic
SuperFanatic T2
Dec 10, 2013
17,534
31,875
113
How exactly? Offensive efficiency is just points per possession as far as I understand it. I guess it's a little more complicated then that as they then modify that offensive efficiency by your opponents "team value index". Where does margin of victory come into play?

PPP and margin of victory kind of go hand in hand. In order to put up high totals you are going to have to be efficient. Someone a lot smarter than me broke it down on titter a couple weeks back.
 

mikeiastat

Well-Known Member
Feb 1, 2007
2,169
708
113
Madison, WI
A rose by any other name... . .

Well a turd by any other name. ..

It's just amusing that too many people are too dense, too stupid, or too lazy to see that with a little deriving that it is the same info, breaking it out to offense and defense is just as bad if not worse.

Breaking it into 2 categories is just putting a sad and very crooked mustache on MOV.
 

LivntheCyLife

Well-Known Member
Nov 25, 2006
2,009
1,020
113
St. Louis, MO
That's fine. I'm just pointing out that NET doesn’t use margin of victory any more. I disagree that wins vs SOS is all that matters. There are many other performance metrics that should be considered in a power ranking. The people who follow this most closely, bettors and handicappers, have known this for decades. The RPI flat out sucks. If you want to argue otherwise that's fine, but you aren't going to convince me.

Personally, I think wins vs SOS should be all the matters. It may not be the best prediction but I think the point of sports is to win the game. Taken to the extreme, should the 4 teams that go to the Final 4 be the teams that won their games or the teams with the best performance metric through the first 4 rounds of the tournament? The RPI can be improved but I still believe the system should be based on earning your way in by winning games, not by having better offensive/defensive efficiencies, point differentials, etc.
 

HFCS

Well-Known Member
Aug 13, 2010
75,976
66,476
113
LA LA Land
Personally, I think wins vs SOS should be all the matters. It may not be the best prediction but I think the point of sports is to win the game. Taken to the extreme, should the 4 teams that go to the Final 4 be the teams that won their games or the teams with the best performance metric through the first 4 rounds of the tournament? The RPI can be improved but I still believe the system should be based on earning your way in by winning games, not by having better offensive/defensive efficiencies, point differentials, etc.
It’s calmed down a ton lately but 5-10 years ago I bet a small minority of fanatics would have welcomed using KenPom to select a final four.
 

PSYclone22

Visual Analytics Mercenary
SuperFanatic
Aug 15, 2012
5,103
3,211
113
Des Moines
Five factors in NET Rating:

Win %
Adjusted Win % (based on home / road / neutral)
Team Value Index (the modeled analytic metric)
Scoring Margin (capped at 10 points)
Net Efficiency (points per possession minus points allowed per possession)

 

PSYclone22

Visual Analytics Mercenary
SuperFanatic
Aug 15, 2012
5,103
3,211
113
Des Moines
I'd hazard that the reason we jumped so much after Saturday was less that there are major flaws with NET Ranking and more because there are a lot of closely ranked teams in the 30-50 range.
 

NorthCyd

Well-Known Member
SuperFanatic
SuperFanatic T2
Aug 22, 2011
21,263
36,041
113
Personally, I think wins vs SOS should be all the matters. It may not be the best prediction but I think the point of sports is to win the game. Taken to the extreme, should the 4 teams that go to the Final 4 be the teams that won their games or the teams with the best performance metric through the first 4 rounds of the tournament? The RPI can be improved but I still believe the system should be based on earning your way in by winning games, not by having better offensive/defensive efficiencies, point differentials, etc.
It's at large selection and seeding criteria for the tournament that arguably already has way too many teams. No one is proposing these be used to decide a champion. The biggest impact is what teams at the margins get left out. Generally the same teams are going to be at the top and the same teams are going to be at the bottom ni matter what criteria you use with a few exceptions. Using SOS is just another factor that can be determined in various ways and manipulated to benefit certain teams. Why don't you just propose straight up record as the criteria then? All at larges are filled by best records. Wins and losses are all that matters.
 
Last edited: