Baseball (and other sports) has been the target of many machine learning experiments. It is easy to see why; people bet on sports games. If an accurate predictor existed, the owners could make money at sports betting businesses. We began with the same motivation, but as fans, money is not really what we are looking for; we are much more interested in what makes a good baseball team. So while we attempted to optimize accuracy, we also investigated which attributes of a team influenced their victory most and whether often-discussed stats really matter to victory. In the process, we hoped to become more informed fans, and to have this in turn increase our enjoyment of baseball.