View unanswered posts | View active topics It is currently November 1st, 2014, 4:29 am



Reply to topic  [ 9 posts ] 
 How NFL teams ignore basic economics and draft players irrat 
Author Message
Modmin Dude
User avatar

Joined: December 31st, 2004, 9:55 am
Posts: 12153
Post How NFL teams ignore basic economics and draft players irrat
Thought this was an interesting piece:
Vox wrote:
How NFL teams ignore basic economics and draft players irrationally
Updated by Joseph Stromberg on May 7, 2014, 1:00 p.m. ET

The NFL draft begins on Thursday. In the football world, it is a huge deal.

For non-football fans: this is when NFL teams select college football players to add to their rosters, the new players awkwardly hold up jerseys with the number one on them, and football fans everywhere freak out. The worst teams are given the highest picks, and if they want to improve, they need to use them as shrewdly as possible.

Teams that succeed — like the Seattle Seahawks, winners of this past season's Super Bowl — tend to build their rosters heavily through the draft, and merely supplement their drafted talent through trades and free agency. NFL executives invest huge amounts of time and resources into scouting players and ranking them, hoping to draft stars in the first round and solid contributors later on.

But here's the thing: despite years of data, most NFL teams still have no idea how to work the draft most effectively.

It's not their imperfect player evaluation, but something more basic — their refusal to follow the principle of risk diversification. That's the conclusion economists Cade Massey and Richard Thaler came to after analyzing fifteen years of draft data in a series of papers — and it's still true, despite recent changes to the wages rookies are paid.

Draft picks can be traded, and the success of any one player picked is highly uncertain. Because of that, their data says that in the current trade market, teams are always better off trading down — that is, trading one high pick for multiple lower ones — but many teams become overconfident in their evaluation of one particular player and do the exact opposite: package several low picks for the right to take one player very early.

"There are one or two teams out there that philosophically follow this idea," says Massey, who serves as a draft consultant with several NFL teams that he can't disclose. "But in my experience, teams always say they're on board with it in January. Then when April rolls around, and they've been preparing for the draft for a long time, they fall in love with players, get more and more confident in their analysis, and fall back into the same patterns."

1) It's just not worth it to trade up

The first analysis Massey and Thaler did was to compare what teams are willing to pay to pick higher (in terms of extra draft picks packaged as part of a trade) with the value they ultimately get out of doing so, in terms of player production.

To calculate how much teams pay to trade up, they looked at 1,078 trades made between 1990 and 2008. The trades work something like this: a team will trade the 16th and 32nd overall picks, say, for the 5th overall pick. They might also include picks from next year's draft.

Massey and Thaler graphed all trades, which let them assign a relative value to each pick in the first five rounds of the draft:
Image
The most important thing about this graph: the curve is very, very sharp in the first round (picks 1 through 32). That means teams think the very top picks are extremely valuable: the value of the 10th pick is only about half that of the first pick.

Now, it's worth pointing out that for years, most teams followed something called "The Chart," which assigned theoretically fair point values to each pick in the draft for trade purposes. Since 2008, many teams have smartly stopped treating "The Chart" as gospel, and the curve has become slightly less steep.

But Massey says it still hasn't flattened out to anything near where it should be, in terms of the actual value derived from the players picked.

He and Thaler figured this out by calculating the odds that the first player picked at any given position will perform better — in terms of the number of games he starts in his first five seasons — than the second player drafted at that position. This is relevant because a team will often trade up when they identify a player they prefer at a needed position: they need a wide receiver, and a few highly-rated ones are available, but they trade up because they're certain one is much better.

But the data says that teams just aren't very good at figuring out when this is true. On average, the chance that first player will start more games than the second one picked at his position: 52 percent. Compared to the third, it's still only 55 percent, and compared to the fourth, it's merely 56 percent.

These numbers suggest that moving up eight picks (the average distance between the first and second players at the same position) should cost a small amount, since you're only increasing the odds of a getting a more productive player by four percent or so. But as the steep curve shows, teams pay a ton to move up, especially at the top of the draft.

"It's basically a coin flip," Massey says, "but teams are paying a great deal for the right to call which side of the coin."

One recent trade epitomizes this point — and shows that even in the post-"Chart" era, teams still overvalue the highest picks. In 2012, the Washington football team traded the 6th pick, the 39th pick, and their first round picks in 2013 and 2014 to the St. Louis Rams so they could move up four spots and take Robert Griffin III — a player they were certain was a once-in-a-lifetime quarterback — with the second overall pick.

Just two years later, the trade already looks pretty shortsighted. That's not because Griffin is a bad player (he's almost one of the few that might make a crazy trade like this seem worthwhile), but because the odds of getting a great player with one high pick are so much lower than getting one with four high picks.

The team would've been better served sitting tight and just drafting the next-best quarterback (Ryan Tannehill) and using the other three picks on much-needed players. Or they could have waited and drafted a quarterback this year — say, Johnny Manziel — when they would've had the 2nd overall pick themselves if they hadn't made the trade.

2) It really pays off to trade down
Given that teams, on the whole, are irrationally willing to pay a lot to trade up, smart teams can reap huge benefits by trading down. Even staying put and drafting from your original spot, the researchers' analysis shows, is not a good strategy.

For each pick in the first round, they calculated all of the different two-pick packages a team could've gotten by trading down, based on the historical data (a team with the first pick, for instance, could get the 2nd and 181st picks, or the 14th and 15th picks, or any combination of picks in between that provide the same sum value).

Then they calculated what teams get out of these picks on average, in terms of the number of starts a player provides in his first five years and the number of Pro Bowls he's voted to. (They included Pro Bowls to counter the criticism that their analysis ignores the unique impact of superstar players solely available in the first few picks.)

Again, the data was unequivocal. On average, trading down and getting two players gave a team five more starts per season and slightly more total Pro Bowls.

You could chalk this up to the simple fact that more players start more games, but it's more than that. Even if you imagined that the team trading down could only keep the better one of the two players it drafted, it'd still get slightly more total starts and the same number of Pro Bowls. The truth is that teams are imperfect talent evaluators, so having two later picks is better than a single early one. Risk diversification at work.

3) Players picked lower are cheaper
All of these reasons to trade down don't even include the fact that players picked later in the draft get paid lower salaries, because the NFL collective bargaining agreement sets wages for the first few years of players' careers based on their draft slot. Saving money matters because all teams have to abide by a hard salary cap — this year, it's $133 million — so paying less to draft picks means more is left over for veteran players.

For every single spot in the draft, the researchers compared the amount of salary paid to a player with the value a team gets from him on the field. (For this analysis, they used a more sophisticated metric for value: they looked at the average statistical production yielded by a player taken at that spot of the draft between 1994 and 2008, then converted that into dollars, based on what teams paid a player with that level of production on the free agent market on average).

In the graph below, the red line is the actual salary paid to a player picked at each spot, the green line is the average performance provided, and the blue is the difference — the money you save drafting someone at that spot instead of having to pay more for a veteran free agent who'd play at a similar level.
Image
The blue line peaks around pick 33, the start of the second round — making it the sweet spot in the draft. If you had to make one pick, this is where you'd get the most bang for your buck, because there's a pretty good chance of getting a productive player and he won't command a particularly high salary. But since you can get multiple picks by trading a single high one, maximizing value means moving down into round two (picks 33 through 64).

One caveat is that the salary data comes from picks made under the old NFL collective bargaining agreement, which paid players picked in the top 10 considerably higher salaries then they get currently. But the salaries for picks from 10 onward have barely changed — and because trading down is so much more fruitful, Massey says the argument still applies for the first round as a whole.

4) Teams that trade down more often win more games
The most straightforward piece of proof for all this analysis is the fact that trading down and amassing more pick value — in terms of the blue line in the graph above — correlates with more wins on the field.

Massey and Thaler came to this conclusion by looking at the number of wins a team had in any given season between 1997 and 2008, and the total value of all picks they'd made in the previous four years (the amount of time, on average, a rookie is under contract for).

They found that one standard deviation in pick value translated to 1.5 more wins per season on the field. Sure, it's a small sample size, and there's a lot of chance and other factors built into the system — a coach's strategy, for instance — but trading down correlates with a significant amount of victories, given that there are only 16 games in a season.

So why don't more NFL teams follow this advice?
If all teams took note of these findings and corrected their behavior, the principles would no longer apply. Teams would be much less interested in trading up, so the lucrative market for trading down would evaporate.

Why hasn't this happened? One answer is a widely-known psychological bias called the overconfidence effect. As people are given more information, the accuracy of their analysis often hits a ceiling, but their confidence in it continues to increase.

This tendency has been demonstrated in all sorts of areas, from bettors picking horses to psychologists making diagnoses. It's not hard to imagine that NFL general managers — who are given scouting reports on players that cover everything from their body fat percentage to their home life — fall victim to the same sort of overconfidence and, as Massey said, "fall in love" with certain players.

There's also the fact that the sports world as a whole tends to glamorize superstars — leading many to disproportionately attribute a 53-player roster's success to one or two highly drafted players. For a struggling GM, it might seem much easier to trade up and land a guaranteed superstar than patiently fill a roster with competent players.

The problem, though, is that there are no guaranteed superstars — and Thaler and Massey have found that, given a long enough timeframe, no teams are any better at accurately evaluating prospects than others. Sure, a GM might hit a hot streak over the course of a few drafts, but long-term, they estimate that 95 to 100 percent of the difference in teams' odds of striking gold with any one pick is driven by chance.

So the key isn't drafting better — it's just drafting more.

As Cassey noted, there are a few teams out there following his philosophy. In a recent interview, Eric DeCosta — assistant GM of the perennially-successful Baltimore Ravens — dropped a hint about the identity of one of them:
Quote:
We look at the draft as, in some respects, a luck-driven process. The more picks you have, the more chances you have to get a good player. When we look at teams that draft well, it’s not necessarily that they’re drafting better than anybody else. It seems to be that they have more picks. There’s definitely a correlation between the amount of picks and drafting good players.


http://www.vox.com/2014/5/7/5683448/how ... rationally

_________________
Quote:
Clowns to the left of me, Jokers to the right....


May 8th, 2014, 9:09 am
Profile
Player of the Year - Defense

Joined: September 25th, 2007, 3:20 am
Posts: 2799
Post Re: How NFL teams ignore basic economics and draft players i
The entire piece is flawed. Noticed they talk about games played as the determining point where value makes up their argument, but Durham played more games than CJ last year, but would you really think Durham is a better value than CJ? They completely left talent out of the equation, even though they mentioned it early on.


May 8th, 2014, 9:22 am
Profile
Online
QB Coach
User avatar

Joined: August 21st, 2005, 3:36 am
Posts: 3143
Location: Philadelphia, PA
Post Re: How NFL teams ignore basic economics and draft players i
njroar wrote:
The entire piece is flawed. Noticed they talk about games played as the determining point where value makes up their argument, but Durham played more games than CJ last year, but would you really think Durham is a better value than CJ? They completely left talent out of the equation, even though they mentioned it early on.

I was going to say the same thing. Using # of starts as the basis for value is not a good way to do it. By that rationale a guy like Jamarcus Russell looks like a comparable QB to Stafford over the first 3 seasons of their respective careers. Having a player start is certainly better than not, but it's not necessarily a demonstration of value. Later in the article they do say that they used a "more sophisticated metric for value" and that they "looked at the average statistical production yielded by a player taken at that spot of the draft between 1994 and 2008..." I don't understand why they didn't do something similar for the other value metrics as well.

Also, they make an argument about Washington saying they'd have the same pick this year if they had used a different strategy (which may or may not be true), and they say "The team would've been better served sitting tight and just drafting the next-best quarterback (Ryan Tannehill) and using the other three picks on much-needed players." How can the author make a statement like that with any certainty? He's essentially saying that having a QB that didn't work out along with a couple other high picks would definitely do more for them than RGIII has. That could be true, but given the coin-flip nature of draft picks, it's not a certainty by any means.

It's an interesting article for sure, but I think their methods are a bit flawed.

_________________
"Facts are stubborn things; and whatever may be our wishes, our inclinations, or the dictates of our passions, they cannot alter the state of facts and evidence." - John Adams

“The good thing about science is that it's true whether or not you believe in it.” - Neil deGrasse Tyson


May 8th, 2014, 9:36 am
Profile
Rookie Player of the Year

Joined: October 13th, 2005, 9:03 am
Posts: 2315
Post Re: How NFL teams ignore basic economics and draft players i
The article is definitely flawed but so is every analysis when any sort of data is used, data can be or ignored in any argument to make a persons point look valid. I will however say that as much as I like Watkins ability I'm against the idea of giving up any picks in this year's draft to move up for him, maybe #10 and their 3rd and next year's 1st rounder for the other team's top three pick and next year's 2nd rounder. That scenario is highly unlikely but it's hard to give up picks in a draft where they can get a guy that can be a #1 (maybe not a Calvin), but how many of those are in the league and how many are wearing Super Bowl rings? Also do they want to give up a likely starter with that 2nd round pick for a WR that when you split up all the receptions will likely get 40-50 catches? In the end the idea of needing an elite WR let alone two is a media, fan, and fantasy football driven notion. I'd rather have three very good WRs that all warrant equal respect and are interchangeable like the Packers always put on the field. They are all good to very good WRs but nobody is every going to say they are elite like a Calvin or Fitzgerald.

If they land Watkins that's great but it feels like a serious gamble for a WR that I don't think will end up being head and shoulders better than that next group of WRs. I still have questions about Watkins after watching him play, is he going to consistently win the jump balls that Matt throws up there? Will he be able to consistently beat the jam and create separation? The kid is great with the ball in his hands but he didn't do a lot down field in college and was only average when it came to 50/50 balls. With the ball he's electric but too much of what I have seen comes on screen passes and quick hits on slants, which by itself is awesome and what makes a guy like Percy Harvin a x-factor but is that worth mortgaging the draft for?


May 8th, 2014, 10:34 am
Profile
Player of the Year - Defense

Joined: September 13th, 2007, 12:43 pm
Posts: 2716
Post Re: How NFL teams ignore basic economics and draft players i
The problem is that it's not a completely random lottery. A player taken in the seventh round is not as likely to become a hall of fame player as one taken in the first round. There are exceptions like Tom Brady, but they are just that -- exceptions. 70% of the players in the HoF were taken in the first three rounds.

Where it starts to get tricky is where you draw the line? Is it statistically more likely that a player taken at number 5 is more likely to succeed than one taken at 15? Does a player taken at the beginning in the second round have a better chance at success than one taken at the end of the second round? And so on.

Due to the uncertain nature of draft picks, I think you have to come in with a bias against trading up, but I don't think you can completely dismiss the strategy.


May 8th, 2014, 12:44 pm
Profile
Online
QB Coach
User avatar

Joined: August 21st, 2005, 3:36 am
Posts: 3143
Location: Philadelphia, PA
Post Re: How NFL teams ignore basic economics and draft players i
Blueskies wrote:
The problem is that it's not a completely random lottery. A player taken in the seventh round is not as likely to become a hall of fame player as one taken in the first round. There are exceptions like Tom Brady, but they are just that -- exceptions. 70% of the players in the HoF were taken in the first three rounds.

Where it starts to get tricky is where you draw the line? Is it statistically more likely that a player taken at number 5 is more likely to succeed than one taken at 15? Does a player taken at the beginning in the second round have a better chance at success than one taken at the end of the second round? And so on.

Due to the uncertain nature of draft picks, I think you have to come in with a bias against trading up, but I don't think you can completely dismiss the strategy.

Agreed. I think in general, a trade up only makes sense when it is a team that feels that they are only 1 or 2 players away from a championship, and that the player they are trading up for is that kind of player to put them over the top. I have my concerns about a WR being that guy, but we'll see how it all plays out. Either way it'll be interesting.

_________________
"Facts are stubborn things; and whatever may be our wishes, our inclinations, or the dictates of our passions, they cannot alter the state of facts and evidence." - John Adams

“The good thing about science is that it's true whether or not you believe in it.” - Neil deGrasse Tyson


May 8th, 2014, 1:00 pm
Profile
RIP Killer
User avatar

Joined: August 6th, 2004, 9:21 am
Posts: 9499
Location: Dallas
Post Re: How NFL teams ignore basic economics and draft players i
As a fan, and a draft nerd, I tend to fall in love with players and hope the Lions land them. From a practical sense, I believe the general theory behind the data holds true.

Remember what studs all the OTs taken in the top 4 picks last year were going to be; Fisher, Joeckel, and Johnson. You also had two guards in the top 10, Cooper and Womack.

Would you trade Warford for any of them?

These teams pay tons of coaches and scouts to evaluate players, of course they think they are right on their evaluations.

Smart teams must develop philosophies prior to the draft process and stick with them. I actually like the fact that Mayhew always seem to go BPA in the 1st round. It doesn't make fans happy when we don't plug a need but in the long term I think it makes sense and increases the likelihood of landing a decent player. His propensity to trade up, especially in the 2nd round or back into the first, hasn't work and needs to be re-evaluated.

A team would be wise to look at all the historical data on drafts and build a plan around that. Think "moneyball" for the draft. You could probably automate much of the selection process and do much better than picks made by humans.

_________________
Image
LB Tweet


May 8th, 2014, 2:21 pm
Profile WWW
Player of the Year - Defense

Joined: September 13th, 2007, 12:43 pm
Posts: 2716
Post Re: How NFL teams ignore basic economics and draft players i
Quote:
His propensity to trade up, especially in the 2nd round or back into the first, hasn't work and needs to be re-evaluated.


How many times he has he done it? Three? Is that enough samples to draw statistical conclusions from?

What if I was tossing a coin and I threw three heads in a row? Would you say that I'm likely to continue to throw heads? What if I threw 99 heads in a row?

Moreover, why does it matter that he traded for the picks -- at the end of the day, doesn't it boil down to the individual players? For example, if the Lions had drafted Best with their own pick, rather than trading up to get him, would it have made the selection any different?

What about a team that's on the clock, sees a player that they think will be fantastic but passes on them because they already have a franchise player signed to a long-term contract at that position? That sort of skews the data. What if I trade proven players for more draft picks?

The draft is fascinating, and deeply complex when you think about it. But at the end of the day, it's only a small part of the overall team building process.


May 8th, 2014, 2:38 pm
Profile
Player of the Year - Defense

Joined: September 13th, 2007, 12:43 pm
Posts: 2716
Post Re: How NFL teams ignore basic economics and draft players i
But yes, if I was an owner I wouldn't just hire "football guys" to run my front office.

I'd also hire a fair number of ex-hedge fund traders, quants and chicago pit guys. Dudes who have spent years thinking about, and dealing with, randomness.


May 8th, 2014, 3:09 pm
Profile
Display posts from previous:  Sort by  
Reply to topic   [ 9 posts ] 

Who is online

Users browsing this forum: No registered users and 2 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group.
Designed by STSoftware.