One of the questions that has come up is: How can the video scouts who track pitch location data at Baseball Info Solutions (BIS) be as good as Sportvision's very cool Pitch F/X technology that tracks pitch location using hi-tech camera angles. In short, how can a human being be as good as the technology?
The answer is that, at BIS, it's not simply human vs. technology. The equation at BIS is that technology PLUS human review is much better than technology alone. Let me explain. Pitch F/X technology is a huge step forward in baseball analytics and the pitch location data it provides is excellent. But not perfect. At BIS, they take it a step further. Thanks to the fact that Pitch F/X data is publicly available, when BIS video scouts review video to determine pitch location, they also have information about how Pitch F/X plotted the location. The video scout reviews both the actual video of the pitch and the Pitch F/X location to determine where the pitch is located. In essence, pitch location charting at BIS enhances the charting done by Pitch F/X to come up with what BIS believes to be the best data possible, a kind of Enhanced Pitch F/X.
As a way to test this, BIS conducted an impartial study. They selected the 100 pitches from their database of the 2010 season that represented the biggest discrepancies in pitch location between BIS data and raw Pitch F/X data. They then meticulously reviewed video once again on all these pitches. The video scouts reviewed the pitch location and selected the data source, either BIS or Pitch F/X, that they believed best represented the true location.
These impartial video reviewers chose BIS plotted pitch location data 55 percent more often than the raw Pitch F/X location as the correct location. The details: 59 choices for BIS pitch location (Enhanced Pitch F/X), 38 choices for the raw Pitch F/X location, 2 pitches that Pitch FX has since corrected, and one pitch where neither location was close.
While these results still leave room for improvement, they do indicate that the BIS method of enhancing pitch location data improves on the charting of raw pitch location by itself.