Thanks to Rob for pointing this out in the comments.
Monday, March 31, 2008
Thursday, March 27, 2008
Tim Kurkjian and Buster Olney Are Optimistic
After thrilling us with their AL predictions yesterday, ESPN released their NL team capsules today. They're all linked from the MLB Index (although the Rockies' link is broken; their preview is here). I don't really care about the actual previews at all, but the win predictions for each team from ESPN's analysts sure are fun.
These previews have predictions from Jayson Stark, Tim Kurkjian, Buster Olney, Keith Law, and Steve Phillips. I'll get to the more interesting specific predictions next week, but first some more general stuff.
Average Win Predction
This is not complicated. If all 30 teams play a full season, the average team will win 81 games. I don't think this requires any further explanation.
Kurkjian: 82.1
Stark: 82
Olney: 81.3
Phillips: 81.1
Law: 81
Congratulations to Keith Law. The only ESPN analyst who can add. Give that man a raise.
That money should probably come out of the paychecks of Kurkjian and Stark. I would like to see the process these individuals go through when making their predictions. I am pretty sure they look at the list of teams, arbitrarily assign a win total to each one, and that's that.
Here is my question: what's the point? Clearly, the guys who don't consider numbers at all are not good at this. Would it be that hard to add up your predictions and make sure that they're, uh, possible? Also: do they not have editors? If they do, do they not know how to add?
PECOTA Correlation
Law: 0.93
Kurkjian: 0.81
Olney: 0.80
Phillips: 0.80
Stark: 0.78
This is not rocket science. Law's predictions will most likely do very well. He clearly at least put some thought into this. The others will do about as well as yours or mine would do if we arbitrarily picked numbers for each team. I find it amusing that ESPN trots out these predictions like they mean something. They do not.
Standard Deviation
Phillips: 10.7
Olney: 10.4
Kurkjian: 10.1
Stark: 9.7
Law: 9.0
For reference, PECOTA's standard deviation is 8.4.
Phillips is so absurd. Here's my favorite little stat from all of these: he has 14 teams winning 88 or more games. Think about that for a second- that's one team away from half of baseball. Here is my prediction: Steve Phillips' predictions will not fare well in this post at the end of the year.
Friday, October 12, 2007
ALCS Primer: Game 1
After three grueling days without American League baseball, the ALCS finally begins tonight. I've already written about the rotations, lineups, bullpens, and defenses. And as if that wasn't enough, I discovered that we really shouldn't just look at the Pythagorean records of these two teams and assume the Red Sox are a lot better; it's actually pretty close.
Game 1 Lineups
Against the righty Beckett, I would assume won't do anything weird- Victor catching, Garko at first, Asdrubal at second, Peralta at short, Blake at third, Kenny in left, Grady in center, Gutierrez in right, and Pronk DHing.
Boston is going to start Kielty in right, since he has the platoon advantage against Sabathia, and has hit CC well in his career (.310/.375/.655 in 32 PAs). Beyond that, I would assume it'll be Youk, Pedroia, Lugo, and Lowell from 1st to 3rd, Manny and Coco joining Kielty in the OF, and Ortiz DHing.
Game 1 Starters
Sabathia vs. Beckett is a pretty ridiculous matchup. I had somehow missed this, but Knuckle Curve points out that against lefties this year, Sabathia has walked four while striking out 75. Yes, his K:BB ratio against lefties this year is better than 18:1. Add in 3 HBPs, and 3 HRs allowed, and his Fielding Independent ERA against LHB is 1.49 this season.
That's pretty amazing, although it isn't going to be particularly helpful against the Sox, since with Drew out of the lineup they'll have only one lefty (Ortiz). Sabathia's FIP against righties is 3.48.
I saw on ESPNNews this morning that Beckett has thrown a shutout in three of his last four playoff starts. This is over the span of three series and five years, with a relief appearance in between, but that's still pretty amazing. In his last five October appearances, he has struck out 41 while walking six in 38.1 innings. He has allowed one homer, and his ERA is 0.70. Wow.
Game 2 Bullpens
Well, everybody is rested. There's a good chance that Papelbon will be the only reliever the Red Sox need, if they need any at all. For Cleveland, I would expect Betancourt to see more action than Perez because of all the righties Boston is starting, although they do have a few lefty bats on the bench (Drew, Hinske, Ellsbury, Cora).
One gambling note: here are the odds from BetUS.com for the exact result of the series.
I think that "Red Sox, 4-3" line is pretty good. G7 would either be Beckett (if they pitched him on short rest in G4) or Matsuzaka, against Jake Westbrook. In Boston. These lines only give Boston a 56.5% chance of winning that game. If it comes to that, even if it's Matsuzaka against Westbrook, Boston is going to be a much bigger favorite than -130, which is the corresponding line for 56.5%.
Completely unrelated, but can everybody (read: ESPN) please shut up about this interference call last night. It was a good call, he went out of his way (intentionally or not) to prevent Matsui from completing the DP. Where is the debate here?
G1 starts in about 3.5 hours, so it's finally time for a prediction. I'm gonna go with Indians in 6. I think Boston wins tonight, but the Indians take G2. Then the Indians take 2/3 in Cleveland (I'm not gonna bother trying to predict the exact games, since we don't really know who Boston's G4 starter is), then Fausto ends it in G6. I'm sticking with my "Fausto becomes famous" prediction.
Update: I would just like to add that my "gorilla math*" has CLE +151 as giving the bettor about a 10% advantage tonight.
*The Urban Dictionary definition for that term is awesome.
Completely unrelated, but a new college football blog written by some friends of mine who are reasonably intelligent: Week 7 Picks [Little Men on Campus]
This Week's Links (10/8-10/12)
Shockingly, Dick Vitale's playoff predictions were quite poor.
There is a new "Boom King", apparently.
Basketball Prospectus made its debut this week.
The PITCH f/x data is available to everybody, which is kind of cool.
Manny Acta dislikes bunting, and enjoys blogs.
Sheehan in his chat yesterday:
"I'll go one further: no one should sign any free agents this offseason. The chance that a 2007-08 free agent will generate a positive return over the life of his contract is comfortably under 10%"Leitch's NY Times playoff blog:
"Analysts are still trying to figure this whole Rockies business out. During last night’s game, TBS broadcaster Bob Brenly went back to the basics. “They play the game,” he said. “They pitch. They catch.”
These are admirable attributes in a baseball team, and are undoubtedly keys to a successful baseball franchise. That no one thought to mention this before September 2007 speaks poorly of previous Rockies management, I think."
Finally, music news that nobody except me cares about. In a recent interview, Jay-Z described his upcoming album as "the lyrical side of Reasonable Doubt meets the musical majesty of Blueprint". That would be incredible, and though I doubt it's even possible, I appreciate the sentiment. More Hov: "Roc Boys", "Blue Magic" video.
Tuesday, October 2, 2007
Here We Go
This little tournament starts in a couple hours, which is pretty exciting. So I have this for reference, here are the final series prices:
COL (+120) @ PHI (-140)
CHC (-135) @ ARI (+115)
LAA (+150) @ BOS (-180)
NYY (-180) @ CLE (+150)
In general, these correlate pretty closely with the run differentials:
COL (+102) @ PHI (+71)
CHC (+62) @ ARI (-20)
LAA (+91) @ BOS (+210)
NYY (+191) @ CLE (+107)
Colorado is +102? They're +51 over their last 15 games; their Pythag W% over that time is .777, which is pretty amazing. That's really the only series where the run differential and odds don't agree. Christina Kahrl did the writeup for this series on BP, and picked the Phillies in 5. Interesting.
I hadn't realized just how good Boston's pitching is. They ended up with the least runs allowed in baseball (657), although that's kind of unfair since SD played the extra game (they ended at 666). Considering the Padres' home park, that means Boston's pitching was considerably better. Wouldn't have guessed that.
I guess I should make picks. I've had no time over the last two days, so these are very poorly researched. Put your picks in the comments if you want, but it's probably too late to get any reasonable number of predictions (if you're reading this after the games start, post them anyway, who cares)- you could also post them on TBL.
CLE in 5
BOS in 4
CHC in 4
COL in 5
BOS in 6 (I'll campaign for CC for Cy Young forever, but Beckett terrifies me)
CHC in 5
CHC in 7
Random prediction: Fausto wins G2 & G5 vs. the Yankees, becomes famous.
Other assorted thoughts/links:
Aftter much work, I think I've found the best system for deciding the MVP. Try to argue with THAT. A 3.3 point lead! That means...I have no idea what that means.
On a more serious note, THT released the final Win Shares numbers.
Today's my birthday (20, if you were wondering; you weren't), and at 12:01am I got an e-mail from oddsmaker.com, giving me $20 in free cash to bet. I guess I'm signed up for an account with them, but I've definitely never deposited money. So I suggest you go ahead and sign up for that site and completely lie about your birthday, say it's tomorrow or something. Then bet it all on CC tomorrow. Why not? Too good to be true, of course. You can't bet the bonus money unless you deposit. I was gullible because during CBB season something similar happened, and I was able to wager it. Sorry if I wasted your time.
Wakefield is hurt; so that's why they took the longer series. Makes sense now.
Finally, SITE NEWS: The NL RoY poll is ending today at 4ET; you should vote if you haven't done that yet. For Tulo. (I always forget that RSS people can't see the polls, so I should probably mention them in the posts.). AL Cy Young poll will be up tonight. I was thinking just CC, Fausto, Beckett, Lackey, but if you would vote for someone else please leave it in the comments so I can add them. Unless it's Wang.
Enjoy the games. An entire post of me complaining about Joe Borowski later tonight.
Evaluating April MLB Predictions (Again)
This was a lot of fun, and there's more to look at, so I thought it deserved another post.
First, the final standings. Methodology is slightly different, as I'm using RMSE (Root Mean Squared Error) rather than just average error. This penalizes large misses more (sorry, Buster), and is more widely used.
As we'll see, Neyer comes out on to pretty much any way you do this. Notice the top five are all at least based on statistical systems. Be sure to remember that when you're watching Baseball Tonight next March. Your time is probably better spent subscribing to BP.
Just for fun, I also looked at how many of the Vegas over/unders everybody chose correctly. A lot of this is luck- if the line is 83.5, and your prediction is 84, you get the same credit if that team wins 84 or 104. (BTW, Silver is Nate Silver from BP; he's the "PECOTA guy", among other things. As I understand it, he took the PECOTA predictions and just made adjustments where he saw fit.)Again, pretty meaningless, but Caple and Law both jump way up. Gammons is last, but I wouldn't be too worried about that- I'm pretty confident he didn't place any wagers.
Now, the following is very interesting. Sky beat me to this (although I believe he did straight difference rather than RMSE), but if we really want to know how good these predictions were, we should look at Pythag record.
Basically, Pythag record is how many games a team should have won, based on how many runs they scored and allowed. It's a better at predicting future performance than actual record, and thus is a better indicator of team strength. It's great for this exercise, so lets take a look.
These numbers are noticeably lower. This makes sense- there is less variation in Pythag record than actual record (I think). I found this table to be very interesting. Sports Interaction jumps up considerably, which doesn't surprise me. Think about how much money these guys have at stake with this stuff. It's their job to post a number that will entice people to bet equally on both the over and the under. I would hope they are good at it- it's a lot different than Steve Phillips handing in a list of completely arbitrary numbers to some ESPN editor.
Beyond that, the list is once again dominated by the "numbers guys". I am somewhat surprised that Olney did so poorly.
The obvious next step is to see who got lucky, and whose picks were better than they originally appeared. Since the average Pythag miss was 1.39 smaller than the average actual miss, I have taken that into account in the final column. A negative "Adj Diff" means you got lucky.
Phillips' picks were poor to begin with, and he got unlucky on top of that (which is only fair, considering his recent good luck in other areas). Olney had the worst picks according to Pythag by a pretty wide margin, but had luck on his side, which allowed him to almost catch up to Phillips.
The numerical systems all obviously did better than others regardless of what metric I've looked at, but they were also on the lucky side. I would be interested to see if this is also true in previous years (which would indicate that it's not actually luck). The PECOTA predictions for each year since 2003 are readily available, so when I have time I figure I'll look into those.
Monday, September 24, 2007
Evaluating April MLB Predictions
Everybody makes baseball predictions in late March/early April. A lot of people just predict who will win each division, and who will advance to the World Series. Anyone can do this- you really only have to have a general knowledge of the top teams.
There are also people who predict how many wins each of the 30 teams will have. There are various complications with this (Jayson Stark's predictions have the average team winning 83.6 games, which is quite unlikely), but the thing about this is you actually have to know what you are doing. People make these predictions differently- some rely strictly on numbers, others on "feel".
I found 13 sets of these predictions- 10 from ESPN (Gammons, Stark, Crasnick, Olney, Neyer, Kurkjian, Phillips, Law, Caple, Karabell), two from BP (PECOTA and BP Hit List), and also the over/unders from SportsInteraction.com (via SoSH). I thought I'd take a look at some of the best and worst individual predictions, as well as whose overall predictions were most accurate.
(Note: These lists aren't just based on who was the closest- I also factored in how far off the other predictions were. So predicting at team within two games if the average prediction was eight games off would be higher than predicting a team exactly if the average was just three games off.)
The Best
1. PECOTA, Chicago White Sox
Predicted wins: 72
On pace for: 71.0
The over/under for the White Sox was 89.5, and the ESPN analysts average prediction was 84.6. Chicago won 90 games in '06 after winning 99 in 2005. Much was made of PECOTA's pessimism, but this turned out to be, pretty easily, the best prediction of the year.
2. Jayson Stark, Seattle Mariners
Predicted wins: 85
On pace for: 86.6
The average for everyone else was 76.5, and PECOTA had them winning only 73 games. They only won 78 games in '06, while finishing last in the AL West. ESPN's preview had JJ Putz under "Bust", as they were worried about his elbow pains. I feel like that turned out OK for him.
3. Steve Phillips, Minnesota Twins
Predicted wins: 78
On pace for: 78.6
Steve Phillips: Not Smart! Well, for now at least. Nobody else at ESPN had the Twins winning less than 83 games, and PECOTA pegged them at 90. On the ESPN Message Boards, Twinsdude08 remarked that, "The Twins just have too much talent to not win the division." I don't know how Phillips came to 78 wins, but, as well see later, this accuracy certainly isn't a trend.
4. Rob Neyer, Washington Nationals
Predicted wins: 69
On pace for: 71.1
People (especially Buster Olney), thought the Nationals were going to be really bad. The second most optimistic ESPN prediction was 64 wins; six had them losing over 100 games. Neyer, who always refers to his predictions as "running the numbers", was more realistic- it's hard to lose 100 games in the NL, since all the other teams are really bad too.
5. Peter Gammons, Colorado Rockies
Predicted wins: 84
On pace for: 87.2
The Rockies have far exceeded all expectations- their over/under at SportsInteraction was 74.5 wins, and nobody else had them winning even 80 games. Even Gammons didn't see this coming, but everybody else was so far off that his prediction makes the list.
The Rest (Predictor, Team, Prediction, Actual Pace)
6. Phillips, Orioles, 70, 69.4
7. Karabell, Pirates, 69, 68.9
8. Caple, Marlins, 68, 68.6
9. PECOTA, Oakland, 80, 77.3
10. Stark, Red Sox, 96, 96
Now for the fun part...
The Worst
1. Buster Olney, Washington Nationals
Predicted wins: 49
On pace for: 71.7
Pretty much everyone was a little off on the Nats, but this one stands out. Sure, things didn't look good back in March, but 113 losses? No NL team lost more than 96 games in '05 or '06- it would be quite amazing if someone was actually that bad. Olney is a smart guy, but I'm not sure where he got 49 wins from.
2. Jim Caple, Kansas City Royals
Predicted wins: 54
On pace for: 70
I don't know, maybe people just think it's funny to pick teams to be amusingly bad. I kind of see Caple's reasoning here, as he predicted the other four AL Central teams to average 89 wins. But seriously, how did he see this playing out? Did he figure they would all go like 16-3 against the Royals? Thats the only way they could average 89 wins, since they have to play each other so many times.
3. Steve Phillips, Boston Red Sox
Predicted wins: 82
On pace for: 96
This only came out third in my little formula, but that may be generous. Boston was a mess in '06, and they still managed 86 wins. Nobody else had the Red Sox winning less than 90 games. Between this and repeatedly predicting the Yankees to miss the playoffs in August, I feel like Phillips just makes predictions for the shock value of them.
4. Keith Law, Seattle Mariners
Predicted wins: 65
On pace for: 86.6
Law and Stark didn't quite see eye to eye on this one, as their predictions were 20 wins apart, the highest such margin. Seattle has surprised people, but their over/under was 79.5 wins; there really wasn't any reason to think they would approach 100 losses.
The Rest (Predictor, Team, Prediction, Actual Pace)
5. Philips, Diamondbacks, 78, 90.8
6. Phillips, White Sox, 92, 71
7. PECOTA, Devil Rays, 78, 66.4
8. Karabell, Cubs, 75, 86
9. Stark, Reds, 85, 74.2
10. Karabell, Astros, 88, 70.5
Now, let's look at whose overall predictions were the most accurate. The table on the right is ranked by how close people were, on average of all 30 predictions.
The top three are all predictions based on numbers. PECOTA is 100% quantitative, and both Neyer and the Hit List rely heavily on numerical predictions.
Those are the only three that did better than Vegas. Neyer did really well- his picks are 19-10-1 against the over/unders so far. Even more impressive, of his seven predictions that had large discrepancies with Sports Interaction, he was right on six of them.
On the other end of the spectrum is, not surprisingly, Mr. Phillips. If you watch Baseball Tonight and SportsCenter (or are a Mets fan...) this probably doesn't come as much of a surprise. Luckily, Steve Phillips isn't paid a lot of money to analyze baseball for a living- if he was, his incompetence would be pretty embarassing.
Pictures: Pecota, Phililps, Olney, Law.
Tuesday, September 18, 2007
Steve Phillips: Not Smart!
In case you somehow missed any of Steve Phillips' August ESPN chats, here's a recap:
August 15:
"Mike (Fresno): True or false - the Yankees will make the playoffs.
Steve Phillips: False. The easy thing to say right now is that they will make it because of how they have played out of the All-Star break. But the reason they are winning now is because of their offense, which is very, very good. But to be a playoff team you have to pitch. And I have my doubts that the offense will continue to go as it is going, and I do not think they have the pitching to bail them out when the offense is not there. But they deserve a lot of credit for fighting their way back into this race, because myself, along with many others, counted them out a long time ago."
Yankees' team ERA since August 15: 4.80
Mariners' team ERA since August 15: 5.66
August 22
"Vinny (New York): With a gun to your head, still Seatle over the Yanks for the Wild Card? Yankees are looking pretty impressive, just taking care of most people's "best team in baseball."
Steve Phillips: The Yanks looked good beating an undermanned Tigers team, I agree with you. But I think the Mariners will hold on and win the Wild Card. Their starting pitching is just good enough and their bullpen in unreal. They have one of the best defenses in babseball, and they are starting to produce on offense. I think it is too little too late for the Yankees to make the playoffs."
The Seattle Mariners are third to last in the majors in Defensive Efficiency.
They have scored 4.24 R/G since August 22. This season, the Royals are second to last in the AL at 4.49 R/G.
August 27
"Lee, CT: With the Mariners up 2 games in the wildcard why does this team not get talked about more as a team that is making noise in the AL?
Steve Phillips: Well, I feel like I talk about them just about every show I do. think they will win the Wild Card despite their difficult schedule down the stretch. They have everything you want from a playoff contending team excpet that dominanting starting pitching, but they make up for it with their amazing defense and quality bullpen. This is a big series this week against the Angels, as the Mariners have no fared that well against them (4-8 this season), but most of those loses came earlier this seasson before the Mariners became what they are now. "
Current Wild Card standings:
Photos: Steve Phillips, Steve Phillips, Steve Phillips.