I watched the ESPN cubs game yesterday (Hendricks win) (first time I tuned into ESPN in probably a couple years), just to see what it's like. And crap, I didn't care about the fans. The game cast passed in background "crowd noise". I thought that was all I needed honestly. Now, if it's playoffs, that's a little different.
Also, I would miss WGN, or whoever does the Wrigley Field broadcasts these days, showing the hot chicks in the stands.