BILL JAMES ONLINE

The Final Game Effect

May 21, 2013

                Sunday’s Red Sox game was played under a threat of rain which, sometime in the 7th inning, became real rain, with real umbrellas and three-hour rain delay (May 19, 2013).    This was the last game of the series.   The Red Sox were trying to get out of town and get on to their next destination, and the Red Sox’ announcers were talking about various ways to move the game along under those conditions.   Jerry Remy told about some games when he was playing and batting leadoff, in which the umpires at the start of the game would tell the leadoff hitter for each team something like "We’ve got to catch a plane.  You might look to be swinging at anything on the corners."

                It struck me that I might be able to document that that’s a real effect.   I have a spreadsheet which has some information about every game played in the majors between 1960 and 2011. .. .retrosheet data, obviously.     The file doesn’t have complete play by play or complete records, but it has the box score line for each starting pitcher, the score of the game, and some other stuff.    I organized the data to identify the last game of every home stand; not the last game of each series, but the last game of each home stand.    The last of the home stand, we know the umpires are moving on after the game.    If there is an effect of the strike zone changing because the umpires are leaving town, that’s where it has to show up.

                And it does.   You probably know that studies like this are usually blind alleys.  You chase down an effect that you think should be there, and. . .no evidence of an effect.  You don’t know that the effect doesn’t exist; you just can’t prove that it does.   That’s what happens 90% of the time.   This is the other 10%.   There clearly is such an effect.

                In all games in that file, teams scored an average of 4.42 runs per game—4.49 by the home team, and 4.34 by the road team.    In final games of a home stand, the average dropped to 4.37—4.43 by the home team, and 4.31 by the road team.    We’re dealing with 22,000+ final games of home stands there and with data for two teams (and two starting pitchers) per game, so. . .nothing is random.

                Looking at the performances of starting pitchers, the average number of innings pitched by starting pitchers actually dropped in the final games of home stands, from 18.51 outs recorded on average to 18.40.   This occurs, I think, because teams often have an off day after the final game of a home stand.   Managers are more aggressive using the bullpen when they have an off day coming up, for obvious reasons.

                Starting pitchers in the final games of home stands had a more-than-proportional decrease in hits allowed, runs allowed, earned runs allowed and walks.     Whereas innings pitched per start decreased only from 6.17 to 6.13, hits allowed by starting pitchers (in these starts) decreased from 6.19 to 6.12.     Runs allowed per nine innings decreased from 4.52 to 4.47, and the ERA of starting pitchers under these conditions improved from 4.09 to 4.05.

                Of most relevance to our enquiry, walks per nine innings decreased under these conditions from 3.11 to 3.08, while strikeouts increased from 5.69 to 5.80.    The large increase in strikeouts is the most striking thing about the study, no pun intended.    It is much larger, as a percentage, than any other effect measured by the study, in part because there is a technical problem which is causing it to be over-measured.

                We know that these effects exist, then, and we also know that these effects in real life are significantly larger than we have measured them as being.   We know this, first, because in the data I stated before, I contrasted the overall rates of data with the rates of performance in the final games of home stands.   In other words, the final games of home stands were included in the overall group.   About 20% of games were final games of home stands.   If I had contrasted the performance in final games of home stands with other games, the measured effect would have been about 25% larger.

                The real underlying effect would be larger than the measured effect, as well, for other reasons that are more difficult to evaluate.    The underlying effect would be present in some games in which it was not measured; in other words, there would be some games other than final games of home stands in which the umpires would be looking to catch a plane after the game.    Further, the underlying effect would not absolutely be present in all of the final games of home stands, because, in some cases, the umpires would be flying out the next day, rather than on the evening after the game.   This causes a "mixing" of the data, and the mixing of the data causes the effects to be under-measured—in the same way that, if you combined at bats of Mickey Mantle with a certain unknown number of at bats by other hitters of unknown quality, that would understate Mickey Mantles’ ability as a hitter.    But what we can certainly conclude is that the effect is real.

                OK, then there is the "surprise" part of the research.   Remy joked about playing back in the stone age, before umpires could be disciplined for making outrageously bad calls or for just being lousy umpires, before umpires were subject to the scrutiny that they are today.     I thought, then, that the effect might have been larger in the earlier part of the data than in the more recent seasons. 

                I divided the data, then, into two sections—what we could call the Yastrzemski years (1960 to 1981) and what we could call the computer age (1982 to 2011).   My thesis was that the effects might have been larger in the Yastrzemski era than in modern baseball.

                Here’s the surprise.   The exact opposite was true.   In fact, all of the observed effect—all of it—was from the computer age.   In the years 1960 to 1981, there is no Final Game effect which is observable in the data.

                Be careful to note what I am saying there.   I am not saying that the Final Game effect did not exist or did not operate in the earlier era.   What I am saying is that we cannot observe it in this data.   In fact, in the years 1960 to 1981, while the "bullpen usage effect" did operate in these games—that is, starting pitchers came out of the game sooner—the hits allows, runs allowed, and ERA of the starting pitchers in final games was actually higher—worse—than in other games.    In that era, the ERA of starting pitchers in all games was 3.69; in final games of home stands, it was 3.73.   Walks per nine innings did decrease slightly in that era, from 3.04 to 3.01, but so did strikeouts, from 5.24 to 5.23.

                What explains this?

                What must explain the data is that there is some other effect in final games of home stands in that era which is masking the Final Game Effect in the data.    What is the other effect?

                I would guess that it is double headers.    In that era, double headers were much more common than they are now.   Scheduled double headers were much more common then than they are now, but also rainout/makeup games were more common then than now.   Rainouts were more common then than they are now.   The fields weren’t as good, the grounds crews weren’t as good, and they couldn’t handle as much rain.   In the final game of a home stand, in that era, there was very often a double header. . ..probably 30, 40% of the time.

                The pitchers who started the second games of double headers were, on average and in general, somewhat weaker than other starting pitchers.  A lot of times a guy who was normally a long reliever would start the second game of a double header.   In the data that I have here I can track the quality of starting pitchers, and the data does show this to be true, although it shows it to be a much smaller effect than I would have guessed.    The larger effect appears to be that second games of double headers are just different.    Since the time required to play a double header is difficult to predict, you probably don’t schedule an umpire’s flight to leave town an hour after the second game is supposed to be over.    I would guess that when a double header was to be played on that day, the normal practice (in that era) was to schedule the umpires to fly out the next morning, rather than on the evening after the double header.     That’s my theory; that’s the best I can do to explain why the Final Game effect is not seen in the data from that era.

                But those of you who are sophisticated in understanding data will immediately spot the other implications of this.   If the effect is not observable in some of the data, that must mean that the effect is larger and stronger where it can be observed.

                Bingo.    In the computer age (1982-2011), the ERA of starting pitchers in Final Games of home stands improves from 4.32 to 4.18.    Strikeouts increase by more; walks decrease by more.  That’s not all a "Final Game" effect, actually.   In the computer age, the quality of pitchers pitching in the final game of a home stand actually is a little better than the overall quality of pitchers.

                I understand why that happens. . .it’s a little difficult to explain, and probably requires more time than it justifies.    It has to do with keeping your best pitchers on their slot.  In modern baseball there are very few double headers, so that effect essentially disappears.   In modern baseball the usage patterns of pitchers are much more regular than they were years ago.    In modern baseball everybody uses a five-man rotation—but that doesn’t mean that the pitcher pitches every fifth day.    A pitcher starting on a five-day rotation will make about 50% of his starts on four days’ rest, and about 50% on longer rest, because of off days in the schedule.

                It will happen sometimes that your best starting pitcher would be on five days rest anyway, because of an off day or a rain out, but, with an off day coming up after a home stand, he would be working on six days’ rest.   In that situation, a manager will often jump his #1 pitcher up in the rotation so that he works on four days’ rest, rather than six.    It’s just a small effect, but it is enough to cause the overall quality of pitchers working in the Final Games of home stands to be slightly better than average, which causes the Final Game effect to be slightly over-measured in the "computer age" part of this study.

                Anyway, what we know now is:

                1)  The "Final Game Effect" postulated by Jerry Remy during that broadcast is certainly real and measurable,

                2)  The effect is obviously larger than we have measured it because of unavoidable "mixing" of the data, and

                3)  The effect is also being masked, in part of the data, by other and irrelevant effects.

                Our study showed that strikeouts per nine innings by starting pitchers in the Final Game of a home stand increase, walks decrease and runs scored decrease.   I think we can safely conclude, because of the "mixing" and "masking" effects that we know are there, that the real underlying effects are probably twice as large as our estimates of them.     The umpiring is different when the umpire has to catch a plane after the game, and it does change the game.

 

Technical Point

Don’t Read This Unless You Like to Be Bored

                For technical reasons, the increase in strikeouts in the Final Games of home stands, which shows as an increase from 5.69 to 5.80 per nine innings, is being slightly over-measured.    The reason for this is as follows.

                Over time, home stands have gotten shorter (and road trips have gotten shorter.)    This means that the percentage of games which are final games of home stands has increased.   Also, over time, strikeouts have steadily increased.    That creates a "common bias" which unites strikeouts and final games of home stands, and this causes the increase in strikeouts in final games of home stands to be measured as being slightly larger than it actually is.

 

Tag Along Study

                While I was studying this, I thought I would also study first games of home stands (and second games, and third games, etc.) to see what effects might be observed there.

                That part of the study doesn’t show much.   The average quality of a starting pitcher in the first game of a home stand is better than in undescribed games—both by the home team and the road team, but particularly by the "home" team.    You can probably figure out why that happens; it has to do with off days before the home stand starts.   Anyway, for that reason, the winning percentage of the home team in the first game of a home stand is .545, whereas in the second game it is .540, in the third game .536, in the fourth game .534.    After that it tends to go back up slightly, in part because after that, the #1 starter is starting again.  

                Other than that, and the point that home stands have gotten significantly shorter over the years, that part of the study really doesn’t show very much.

 
 

COMMENTS (20 Comments, most recent shown first)

OldBackstop
I think what is not stated but perhaps well known is that the umps stay put for an entire home stand? Did not realize that.

I think the original premise by the Red Sox guys wasn't just for getaway days but for getaway days with a rain delay and/or perhaps extra innings. My guess is that if you just looked at those situations, and where able to overlay data about the actual umps' travel plans (whether they were missing a flight or not) the numbers would be off the charts.
2:36 PM Aug 17th
 
shthar
What if you divided the results by when teams/umps travelled by plane and travelled by train?

There'd be a few years in there where they did both. But at some point, train travel stops.



11:23 PM May 27th
 
3for3
What about the time saved?
11:49 AM May 25th
 
bjames
Sorry I am late to join the discussion here. . .I've been traveling. The winning percentage of the home team did NOT change in the final game of a homestand. Given the whole sweep of the period, the home teams had a .5396 winning percentage overall, and .5396 in the final games of home stands.

It may be true that umpires rotate constantly now, but the study goes back to 1960. I thought it would be risky to ASSUME that the policy of moving umpires after the series has been in place consistently since 1960.
4:49 PM May 24th
 
KaiserD2
Yes. I was simply saying, if this really is happening because the umpires have to catch a plane, then it should happen in the last game of every series.

DK
9:55 AM May 23rd
 
lidsky
@tangotiger: True on the sample size, but I think what Kaiser is suggesting is a way to validate the hypothesis that it is the upcoming travel day of the umps that is impacting the game. If he isn't suggesting it, then I guess I am.
11:40 PM May 22nd
 
Trailbzr
Well, I did the tabulation described in the earliest comment below, and it confirmed my expectation -- (non-pitchers) starting games on Mondays through Saturdays averaged between 108.4 and 110.1 starts for the season. Sunday starters averaged only 106.1, so it appears that more non-regulars play on Sundays than other days of the week.

Whether this translates into the implication that Sunday pitchers face weaker-hitting lineups, and if so, sufficiently to explain the final game difference in offence, is worth looking into.
2:12 PM May 22nd
 
tangotiger
KaiserD2: just because the effect MAY be visible in other cases doesn't take away the fact that it SHOULD be visible in this case.

Bill is not suggesting that umps ONLY travel at the end of a team's homestand.

Your suggestion will increase sample size... but I don't know that sample size is an issue here.


12:49 PM May 22nd
 
StatsGuru
Bill,

Did you measure time of game? I would have expected these games to be much quicker.​
7:46 AM May 22nd
 
KaiserD2
This is an interesting study with interesting results, but something immediately struck me as amiss, and when I checked retrosheet from last year my original hunch was immediately confirmed.
The premises of the study are 1) the umpires might behave differently when they have to catch a plane to another city, and 2) the umpires only have to catch a plane to another city AT THE END OF A HOME STAND. Premise no. 2 is not correct.
It is extremely unusual--if it happens at all--for the same umpiring crew to work two consecutive series in the same city. This was my overwhelming impression before checking data from last year, and the data I began checking confirmed it 100%. Umpires travel much more than ballplayers do, because they spend only one series at a time in the same city. Thus, this effect should be visible, if it actually reflects the umpiring, in the last inning of nearly every series.
DK
7:33 AM May 22nd
 
KevinBrazee
Great analysis.

As someone who reads the rule book and has umpired youth baseball, I am fascinated by the impact of umpires have on the game. I have read studies on how on 3-0 counts, a strike is called on the next pitch based on a "larger" strike zone. The effect is reversed on 0-2 counts.

I wonder what the impact would be between the first 6 innings versus the last 3 innings (or all innings from the 7th on). You could gather all the same info for the early innings and late innings and compare the early innings from getaway days to all others and the same for the late innings. My expectation would be that the effect that you are seeing coud be greater in the late innings.

Finally it would be interesting to look at early and late innings on getaway games versus all others based on overall length of game. What I would be trying to get at ( and not sure if I could) is if the first 6 innings were slow did the umpires speed up the game in the late innings. Without the time through the early innings not sure if that is even possible.
2:03 AM May 22nd
 
mauimike
Mr. James, Sundays, 5/19/13, Angel and White Sox game was a good example of your research. The Soxs had to get home to play Boston on Monday. The Angels had Monday off. John Hirschbeck, was the home plate umpire and crew chief and they needed to get out of town. I was kinda watching the game, when I heard Mark Gubicza, the Angel TV guy, mentioning John's wide strike zone. He kept talking about it and that he wanted to go and put on his uniform. When the umpire had that strike zone, Mark wanted in, damn the age. They showed that Hirschbeck was doing his best Eric Gregg, imitation, calling strikes 3 and 4 inches off the plate. (I wonder why the Angels have two KC boys working in the booth, Victor Rojas and Mark Gubicza and the Royals have two SoCal guys, Steve Physioc and Rex Hudler working in their booth. Do you think any KC fans want to trade?) There were 16 strikeouts, 9 for the Angels, 7 for the Soxs. Trout, had 3 K's. He'll learn, he must think everything is on the up and up.
9:40 PM May 21st
 
sprox
Great article - thanks Bill!

As for the "prepare to be bored" technical point I would guess that less than a tenth of 1% of the people paying for this content would be bored by the paragraph.

I would skip such theatrics in the future.
8:57 PM May 21st
 
deberly
Bill, I love your work and this site.

After saw the headline for this article, but before I started reading, my immediate thought was that a lower run environment would be explained by having all of a team's relievers available as you said.

But even after reading the article, I am not immediately convinced this does not explain the results you find as much as or even more than the umpire affect Remy described.

I was speculating that the use of more, specialized relievers in the Computer era would support this hypothesis and further explain the differences in eras.

Thoughts?
1:57 PM May 21st
 
77royals
Just to clarify, I'm not questioning your understanding of it. This was some good work, just the general consensus that it's the umpires doing it.
12:08 PM May 21st
 
77royals
As a long time umpire, I can understand the question, but have to question the understanding of it.

Sure, the umpires might call the game as Remy suggests. I would also put forth that the teams have planes to catch, and the managers are just as likely to tell the batters to go up there swinging. The managers will also tell the battery to work faster, and not to make unnecessary throws to the bases.

I would also say it's due to the unbalanced schedule, fewer trips into each park each year, and the danger of having to come back on an off day to finish a game.

The umpires might be making the calls, but its within the parameters of what the teams want, not just so they can make their flights.
12:06 PM May 21st
 
mikewright
This is why I subscribe. Gonna be some bored children at my dinner table tonight.
11:56 AM May 21st
 
Robinsong
Enjoyed the article.

It would also be interesting to compare the won-loss record of home teams on the last day with the typical home-team winning percentage. A lead theory of the Sports Illustrated article on home team advantage across sports was that it reflected (perhaps unconscious) bias of officials towards the home team. When umps want to catch the plane, does this get worse or better?


11:11 AM May 21st
 
therevverend
Did you notice a difference between home and visiting teams? I'm sure a fatigued team on the end of a long road trip in August is far more likely to spike up in strikeouts then the home team.
10:33 AM May 21st
 
Trailbzr
If you're using the Retrosheet game logs, can you separate Sundays (which are almost always final games except on holiday wekends) from mid-weeks? I've been on the Orioles Sunday plan since Camden Yards opened, and I'd say we see more games started by backup catchers than by the first string. I don't know if the number of other lineup variations is larger than average, but it SEEMS we miss a lot of players we were hoping to see.

I'm not at home this week, or I'd do this myself, but I think it would be informative to tabulate for each week day, how many games each starter started over the season. I bet Mon-Sat is pretty consistent, with Sun distinctly lower.
8:36 AM May 21st
 
 
© 2011 Be Jolly, Inc. All Rights Reserved.